Nov 14 12:32:01 user nova-compute[75258]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=75258) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=75258) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=75258) initialize /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:44}}
Nov 14 12:32:01 user nova-compute[75258]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.022s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:32:01 user nova-compute[75258]: INFO nova.virt.driver [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Loading compute driver 'libvirt.LibvirtDriver'
Nov 14 12:32:01 user nova-compute[75258]: INFO nova.compute.provider_config [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Acquiring lock "singleton_lock" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Acquired lock "singleton_lock" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Releasing lock "singleton_lock" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Full set of CONF: {{(pid=75258) _wait_for_exit_or_signal /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/service.py:362}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ******************************************************************************** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2589}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Configuration options gathered from: {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2590}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2591}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2592}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ================================================================================ {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2594}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] allow_resize_to_same_host      = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] arq_binding_timeout            = 300 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] backdoor_port                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] backdoor_socket                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] block_device_allocate_retries  = 300 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] block_device_allocate_retries_interval = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cert                           = self.pem {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute_monitors               = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] config_dir                     = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] config_drive_format            = iso9660 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] config_source                  = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] console_host                   = user {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] control_exchange               = nova {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cpu_allocation_ratio           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] daemon                         = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] debug                          = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] default_access_ip_network_name = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] default_availability_zone      = nova {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] default_ephemeral_format       = ext4 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] default_green_pool_size        = 1000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] default_schedule_zone          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] disk_allocation_ratio          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] enable_new_services            = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] enabled_apis                   = ['osapi_compute'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] enabled_ssl_apis               = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] flat_injected                  = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] force_config_drive             = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] force_raw_images               = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] graceful_shutdown_timeout      = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] heal_instance_info_cache_interval = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] host                           = user {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] initial_disk_allocation_ratio  = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] initial_ram_allocation_ratio   = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instance_build_timeout         = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instance_delete_interval       = 300 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instance_format                = [instance: %(uuid)s]  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instance_name_template         = instance-%08x {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instance_usage_audit           = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instance_usage_audit_period    = month {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] internal_service_availability_zone = internal {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] key                            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] live_migration_retry_count     = 30 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_config_append              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_dir                        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_file                       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_options                    = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_rotate_interval            = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_rotate_interval_type       = days {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] log_rotation_type              = none {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] long_rpc_timeout               = 1800 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] max_concurrent_builds          = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] max_concurrent_live_migrations = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] max_concurrent_snapshots       = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] max_local_block_devices        = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] max_logfile_count              = 30 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] max_logfile_size_mb            = 200 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] maximum_instance_delete_attempts = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] metadata_listen                = 0.0.0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] metadata_listen_port           = 8775 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] metadata_workers               = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] migrate_max_retries            = -1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] mkisofs_cmd                    = genisoimage {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] my_block_storage_ip            = 10.0.0.210 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] my_ip                          = 10.0.0.210 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] network_allocate_retries       = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] osapi_compute_listen           = 0.0.0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] osapi_compute_listen_port      = 8774 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] osapi_compute_unique_server_name_scope =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] osapi_compute_workers          = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] password_length                = 12 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] periodic_enable                = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] periodic_fuzzy_delay           = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] pointer_model                  = ps2mouse {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] preallocate_images             = none {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] publish_errors                 = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] pybasedir                      = /opt/stack/nova {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ram_allocation_ratio           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rate_limit_burst               = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rate_limit_except_level        = CRITICAL {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rate_limit_interval            = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] reboot_timeout                 = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] reclaim_instance_interval      = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] record                         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] reimage_timeout_per_gb         = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] report_interval                = 120 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rescue_timeout                 = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] reserved_host_cpus             = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] reserved_host_disk_mb          = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] reserved_host_memory_mb        = 512 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] reserved_huge_pages            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] resize_confirm_window          = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] resize_fs_using_block_device   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] resume_guests_state_on_host_boot = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rpc_response_timeout           = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] run_external_periodic_tasks    = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] running_deleted_instance_action = reap {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] running_deleted_instance_poll_interval = 1800 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] running_deleted_instance_timeout = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler_instance_sync_interval = 120 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_down_time              = 720 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] servicegroup_driver            = db {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] shelved_offload_time           = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] shelved_poll_interval          = 3600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] shutdown_timeout               = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] source_is_ipv6                 = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ssl_only                       = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] state_path                     = /opt/stack/data/nova {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] sync_power_state_interval      = 600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] sync_power_state_pool_size     = 1000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] syslog_log_facility            = LOG_USER {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] tempdir                        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] timeout_nbd                    = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] transport_url                  = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] update_resources_interval      = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] use_cow_images                 = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] use_eventlog                   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] use_journal                    = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] use_json                       = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] use_rootwrap_daemon            = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] use_stderr                     = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] use_syslog                     = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vcpu_pin_set                   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plugging_is_fatal          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plugging_timeout           = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] virt_mkfs                      = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] volume_usage_poll_interval     = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] watch_log_file                 = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] web                            = /usr/share/spice-html5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2602}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_concurrency.disable_process_locking = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.auth_strategy              = keystone {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.compute_link_prefix        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.dhcp_domain                = novalocal {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.enable_instance_password   = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.glance_link_prefix         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.instance_list_cells_batch_strategy = distributed {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.instance_list_per_project_cells = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.list_records_by_skipping_down_cells = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.local_metadata_per_cell    = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.max_limit                  = 1000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.metadata_cache_expiration  = 15 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.neutron_default_tenant_id  = default {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.use_forwarded_for          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.use_neutron_default_nets   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.vendordata_dynamic_failure_fatal = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.vendordata_dynamic_targets = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.vendordata_jsonfile_path   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.backend                  = dogpile.cache.memcached {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.backend_argument         = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.config_prefix            = cache.oslo {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.dead_timeout             = 60.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.debug_cache_backend      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.enable_retry_client      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.enable_socket_keepalive  = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.enabled                  = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.expiration_time          = 600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.hashclient_retry_attempts = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.hashclient_retry_delay   = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_dead_retry      = 300 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_password        =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_pool_maxsize    = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_sasl_enabled    = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_socket_timeout  = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.memcache_username        =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.proxies                  = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.retry_attempts           = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.retry_delay              = 0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.socket_keepalive_count   = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.socket_keepalive_idle    = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.socket_keepalive_interval = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.tls_allowed_ciphers      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.tls_cafile               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.tls_certfile             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.tls_enabled              = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cache.tls_keyfile              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.auth_section            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.auth_type               = password {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.cafile                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.catalog_info            = volumev3::publicURL {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.certfile                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.collect_timing          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.cross_az_attach         = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.debug                   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.endpoint_template       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.http_retries            = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.insecure                = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.keyfile                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.os_region_name          = RegionOne {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.split_loggers           = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cinder.timeout                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.cpu_dedicated_set      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.cpu_shared_set         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.image_type_exclude_list = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.live_migration_wait_for_vif_plug = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.max_concurrent_disk_ops = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.max_disk_devices_to_attach = -1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.resource_provider_association_refresh = 300 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.shutdown_retry_interval = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] conductor.workers              = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] console.allowed_origins        = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] console.ssl_ciphers            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] console.ssl_minimum_version    = default {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] consoleauth.token_ttl          = 600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.cafile                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.certfile                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.collect_timing          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.connect_retries         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.connect_retry_delay     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.endpoint_override       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.insecure                = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.keyfile                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.max_version             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.min_version             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.region_name             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.service_name            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.service_type            = accelerator {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.split_loggers           = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.status_code_retries     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.status_code_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.timeout                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] cyborg.version                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.backend               = sqlalchemy {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.connection            = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.connection_debug      = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.connection_parameters =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.connection_recycle_time = 3600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.connection_trace      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.db_inc_retry_interval = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.db_max_retries        = 20 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.db_max_retry_interval = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.db_retry_interval     = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.max_overflow          = 50 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.max_pool_size         = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.max_retries           = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.mysql_wsrep_sync_wait = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.pool_timeout          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.retry_interval        = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.slave_connection      = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] database.sqlite_synchronous    = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.backend           = sqlalchemy {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.connection        = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.connection_debug  = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.connection_parameters =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.connection_recycle_time = 3600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.connection_trace  = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.db_inc_retry_interval = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.db_max_retries    = 20 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.db_max_retry_interval = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.db_retry_interval = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.max_overflow      = 50 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.max_pool_size     = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.max_retries       = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.mysql_wsrep_sync_wait = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.pool_timeout      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.retry_interval    = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.slave_connection  = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] api_database.sqlite_synchronous = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] devices.enabled_mdev_types     = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ephemeral_storage_encryption.enabled = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ephemeral_storage_encryption.key_size = 512 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.api_servers             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.cafile                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.certfile                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.collect_timing          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.connect_retries         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.connect_retry_delay     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.debug                   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.default_trusted_certificate_ids = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.enable_certificate_validation = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.enable_rbd_download     = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.endpoint_override       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.insecure                = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.keyfile                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.max_version             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.min_version             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.num_retries             = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.rbd_ceph_conf           =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.rbd_connect_timeout     = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.rbd_pool                =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.rbd_user                =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.region_name             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.service_name            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.service_type            = image {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.split_loggers           = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.status_code_retries     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.status_code_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.timeout                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.verify_glance_signatures = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] glance.version                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] guestfs.debug                  = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.config_drive_cdrom      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.config_drive_inject_password = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.enable_instance_metrics_collection = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.enable_remotefx         = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.instances_path_share    =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.iscsi_initiator_list    = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.limit_cpu_features      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.power_state_check_timeframe = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.power_state_event_polling_interval = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.use_multipath_io        = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.volume_attach_retry_count = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.volume_attach_retry_interval = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.vswitch_name            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] mks.enabled                    = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] image_cache.manager_interval   = 2400 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] image_cache.precache_concurrency = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] image_cache.remove_unused_base_images = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] image_cache.subdirectory_name  = _base {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.api_max_retries         = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.api_retry_interval      = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.auth_section            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.auth_type               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.cafile                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.certfile                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.collect_timing          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.conductor_group         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.connect_retries         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.connect_retry_delay     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.endpoint_override       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.insecure                = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.keyfile                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.max_version             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.min_version             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.peer_list               = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.region_name             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.serial_console_state_timeout = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.service_name            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.service_type            = baremetal {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.split_loggers           = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.status_code_retries     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.status_code_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.timeout                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ironic.version                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] key_manager.fixed_key          = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.barbican_api_version  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.barbican_endpoint     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.barbican_endpoint_type = public {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.barbican_region_name  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.cafile                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.certfile              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.collect_timing        = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.insecure              = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.keyfile               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.number_of_retries     = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.retry_delay           = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.send_service_user_token = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.split_loggers         = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.timeout               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.verify_ssl            = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican.verify_ssl_path       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.auth_section = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.auth_type = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.cafile   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.certfile = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.collect_timing = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.insecure = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.keyfile  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.split_loggers = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] barbican_service_user.timeout  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.approle_role_id          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.approle_secret_id        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.cafile                   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.certfile                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.collect_timing           = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.insecure                 = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.keyfile                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.kv_mountpoint            = secret {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.kv_path                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.kv_version               = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.namespace                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.root_token_id            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.split_loggers            = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.ssl_ca_crt_file          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.timeout                  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.use_ssl                  = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.auth_section          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.auth_type             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.cafile                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.certfile              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.collect_timing        = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.connect_retries       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.connect_retry_delay   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.endpoint_override     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.insecure              = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.keyfile               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.max_version           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.min_version           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.region_name           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.service_name          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.service_type          = identity {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.split_loggers         = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.status_code_retries   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.status_code_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.timeout               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] keystone.version               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.connection_uri         =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.cpu_mode               = custom {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.cpu_model_extra_flags  = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: WARNING oslo_config.cfg [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.cpu_power_governor_high = performance {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.cpu_power_governor_low = powersave {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.cpu_power_management   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.device_detach_attempts = 8 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.device_detach_timeout  = 20 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.disk_cachemodes        = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.disk_prefix            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.enabled_perf_events    = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.file_backed_memory     = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.gid_maps               = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.hw_disk_discard        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.hw_machine_type        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.images_rbd_ceph_conf   =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.images_rbd_glance_store_name =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.images_rbd_pool        = rbd {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.images_type            = default {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.images_volume_group    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.inject_key             = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.inject_partition       = -2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.inject_password        = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.iscsi_iface            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.iser_use_multipath     = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_bandwidth = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_completion_timeout = 800 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_downtime = 500 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_downtime_delay = 75 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_downtime_steps = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_inbound_addr = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_permit_auto_converge = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_permit_post_copy = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_scheme  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_timeout_action = abort {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_tunnelled = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: WARNING oslo_config.cfg [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Nov 14 12:32:01 user nova-compute[75258]: live_migration_uri is deprecated for removal in favor of two other options that
Nov 14 12:32:01 user nova-compute[75258]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Nov 14 12:32:01 user nova-compute[75258]: and ``live_migration_inbound_addr`` respectively.
Nov 14 12:32:01 user nova-compute[75258]: ).  Its value may be silently ignored in the future.
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.live_migration_with_native_tls = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.max_queues             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.mem_stats_period_seconds = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.nfs_mount_options      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.num_aoe_discover_tries = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.num_iser_scan_tries    = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.num_memory_encrypted_guests = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.num_nvme_discover_tries = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.num_pcie_ports         = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.num_volume_scan_tries  = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.pmem_namespaces        = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.quobyte_client_cfg     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rbd_connect_timeout    = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rbd_secret_uuid        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rbd_user               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.realtime_scheduler_priority = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.remote_filesystem_transport = ssh {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rescue_image_id        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rescue_kernel_id       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rescue_ramdisk_id      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.rx_queue_size          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.smbfs_mount_options    =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.snapshot_compression   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.snapshot_image_format  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.sparse_logical_volumes = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.swtpm_enabled          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.swtpm_group            = tss {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.swtpm_user             = tss {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.sysinfo_serial         = unique {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.tb_cache_size          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.tx_queue_size          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.uid_maps               = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.use_virtio_for_bridges = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.virt_type              = kvm {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.volume_clear           = zero {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.volume_clear_size      = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.volume_use_multipath   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.vzstorage_cache_path   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.vzstorage_mount_group  = qemu {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.vzstorage_mount_opts   = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.vzstorage_mount_user   = stack {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.auth_section           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.auth_type              = password {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.cafile                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.certfile               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.collect_timing         = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.connect_retries        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.connect_retry_delay    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.default_floating_pool  = public {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.endpoint_override      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.extension_sync_interval = 600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.http_retries           = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.insecure               = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.keyfile                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.max_version            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.metadata_proxy_shared_secret = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.min_version            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.ovs_bridge             = br-int {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.physnets               = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.region_name            = RegionOne {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.service_metadata_proxy = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.service_name           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.service_type           = network {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.split_loggers          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.status_code_retries    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.status_code_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.timeout                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] neutron.version                = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] notifications.bdms_in_notifications = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] notifications.default_level    = INFO {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] notifications.notification_format = unversioned {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] notifications.notify_on_state_change = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] pci.alias                      = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] pci.device_spec                = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] pci.report_in_placement        = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.auth_section         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.auth_type            = password {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.cafile               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.certfile             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.collect_timing       = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.connect_retries      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.connect_retry_delay  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.default_domain_id    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.default_domain_name  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.domain_id            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.domain_name          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.endpoint_override    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.insecure             = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.keyfile              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.max_version          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.min_version          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.password             = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.project_domain_id    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.project_domain_name  = Default {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.project_id           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.project_name         = service {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.region_name          = RegionOne {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.service_name         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.service_type         = placement {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.split_loggers        = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.status_code_retries  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.status_code_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.system_scope         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.timeout              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.trust_id             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.user_domain_id       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.user_domain_name     = Default {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.user_id              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.username             = placement {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] placement.version              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.cores                    = 20 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.count_usage_from_placement = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.injected_file_content_bytes = 10240 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.injected_file_path_length = 255 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.injected_files           = 5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.instances                = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.key_pairs                = 100 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.metadata_items           = 128 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.ram                      = 51200 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.recheck_quota            = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.server_group_members     = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] quota.server_groups            = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rdp.enabled                    = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.image_metadata_prefilter = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.max_attempts         = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.max_placement_results = 1000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.query_placement_for_image_type_support = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] scheduler.workers              = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.host_subset_size = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.image_properties_default_architecture = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.isolated_hosts = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.isolated_images = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.max_instances_per_host = 50 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.num_instances_weight_multiplier = 0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.pci_in_placement = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.track_instance_changes = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] metrics.required               = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] metrics.weight_multiplier      = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] metrics.weight_setting         = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] serial_console.enabled         = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] serial_console.port_range      = 10000:20000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] serial_console.serialproxy_port = 6083 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.auth_section      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.auth_type         = password {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.cafile            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.certfile          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.collect_timing    = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.insecure          = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.keyfile           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.send_service_user_token = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.split_loggers     = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] service_user.timeout           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.agent_enabled            = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.enabled                  = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.html5proxy_port          = 6082 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.image_compression        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.jpeg_compression         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.playback_compression     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.server_listen            = 127.0.0.1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.streaming_mode           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] spice.zlib_compression         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] upgrade_levels.baseapi         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] upgrade_levels.cert            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] upgrade_levels.compute         = auto {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] upgrade_levels.conductor       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] upgrade_levels.scheduler       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.auth_section = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.auth_type = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.cafile = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.certfile = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.collect_timing = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.insecure = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.keyfile = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.split_loggers = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vendordata_dynamic_auth.timeout = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.api_retry_count         = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.ca_file                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.cache_prefix            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.cluster_name            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.connection_pool_size    = 10 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.console_delay_seconds   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.datastore_regex         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.host_ip                 = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.host_password           = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.host_port               = 443 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.host_username           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.insecure                = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.integration_bridge      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.maximum_objects         = 100 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.pbm_default_policy      = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.pbm_enabled             = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.pbm_wsdl_location       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.serial_port_proxy_uri   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.serial_port_service_uri = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.task_poll_interval      = 0.5 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.use_linked_clone        = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.vnc_keymap              = en-us {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.vnc_port                = 5900 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vmware.vnc_port_total          = 10000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.auth_schemes               = ['none'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.enabled                    = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.novncproxy_port            = 6080 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.server_listen              = 0.0.0.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.vencrypt_ca_certs          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.vencrypt_client_cert       = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vnc.vencrypt_client_key        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.disable_fallback_pcpu_query = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.disable_group_policy_check_upcall = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.disable_rootwrap   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.enable_numa_live_migration = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.handle_virt_lifecycle_events = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.libvirt_disable_apic = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.never_download_image_if_on_rbd = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.client_socket_timeout     = 900 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.default_pool_size         = 1000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.keep_alive                = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.max_header_line           = 16384 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.secure_proxy_ssl_header   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.ssl_ca_file               = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.ssl_cert_file             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.ssl_key_file              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.tcp_keepidle              = 600 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] zvm.ca_file                    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] zvm.cloud_connector_url        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] zvm.reachable_timeout          = 300 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.enforce_new_defaults = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.enforce_scope      = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.policy_default_rule = default {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.policy_file        = policy.yaml {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.connection_string     = messaging:// {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.enabled               = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.es_doc_type           = notification {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.es_scroll_size        = 10000 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.es_scroll_time        = 2m {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.filter_error_trace    = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.hmac_keys             = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.sentinel_service_name = mymaster {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.socket_timeout        = 0.1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.trace_requests        = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler.trace_sqlalchemy      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler_jaeger.process_tags   = {} {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler_jaeger.service_name_prefix = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] profiler_otlp.service_name_prefix = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] remote_debug.host              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] remote_debug.port              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.ssl      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_rabbit.ssl_version =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_notifications.retry = -1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_messaging_notifications.transport_url = **** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.auth_section        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.auth_type           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.cafile              = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.certfile            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.collect_timing      = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.connect_retries     = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.connect_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.endpoint_id         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.endpoint_override   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.insecure            = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.keyfile             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.max_version         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.min_version         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.region_name         = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.service_name        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.service_type        = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.split_loggers       = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.status_code_retries = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.status_code_retry_delay = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.timeout             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.valid_interfaces    = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_limit.version             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_reports.file_event_handler = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] oslo_reports.log_dir           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_linux_bridge_privileged.group = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_linux_bridge_privileged.user = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_ovs_privileged.group  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_ovs_privileged.helper_command = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] vif_plug_ovs_privileged.user   = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.flat_interface = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_linux_bridge.vlan_interface = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_ovs.default_qos_type    = linux-noop {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_ovs.isolate_vif         = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_ovs.ovsdb_interface     = native {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_vif_ovs.per_port_bridge     = False {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] os_brick.lock_path             = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] privsep_osbrick.capabilities   = [21] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] privsep_osbrick.group          = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] privsep_osbrick.helper_command = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] privsep_osbrick.thread_pool_size = 12 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] privsep_osbrick.user           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] nova_sys_admin.group           = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] nova_sys_admin.helper_command  = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] nova_sys_admin.thread_pool_size = 12 {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] nova_sys_admin.user            = None {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2609}}
Nov 14 12:32:01 user nova-compute[75258]: DEBUG oslo_service.service [None req-721ea83c-741d-4ef2-9669-2c4bb3d15daa None None] ******************************************************************************** {{(pid=75258) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2613}}
Nov 14 12:32:01 user nova-compute[75258]: INFO nova.service [-] Starting compute node (version 0.0.0)
Nov 14 12:32:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Connecting to libvirt: qemu:///system {{(pid=75258) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:506}}
Nov 14 12:32:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7fd4b48bf040> {{(pid=75258) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:512}}
Nov 14 12:32:02 user nova-compute[75258]: libvirt:  error : internal error: could not initialize domain event timer
Nov 14 12:32:02 user nova-compute[75258]: WARNING nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] URI qemu:///system does not support events: internal error: could not initialize domain event timer: libvirt.libvirtError: internal error: could not initialize domain event timer
Nov 14 12:32:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7fd4b48bf040> {{(pid=75258) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:533}}
Nov 14 12:32:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Starting native event thread {{(pid=75258) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Nov 14 12:32:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Starting green dispatch thread {{(pid=75258) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Nov 14 12:32:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Starting connection event dispatch thread {{(pid=75258) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:501}}
Nov 14 12:32:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Connection event '1' reason 'None'
Nov 14 12:32:02 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 12:32:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.mount [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Initialising _HostMountState generation 0 {{(pid=75258) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Nov 14 12:32:09 user nova-compute[75258]: INFO nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host capabilities <capabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <host>
Nov 14 12:32:09 user nova-compute[75258]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Nov 14 12:32:09 user nova-compute[75258]:     <cpu>
Nov 14 12:32:09 user nova-compute[75258]:       <arch>x86_64</arch>
Nov 14 12:32:09 user nova-compute[75258]:       <model>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <microcode version='1070'/>
Nov 14 12:32:09 user nova-compute[75258]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Nov 14 12:32:09 user nova-compute[75258]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='osxsave'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='invtsc'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='rsba'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature name='skip-l1dfl-vmentry'/>
Nov 14 12:32:09 user nova-compute[75258]:       <pages unit='KiB' size='4'/>
Nov 14 12:32:09 user nova-compute[75258]:       <pages unit='KiB' size='2048'/>
Nov 14 12:32:09 user nova-compute[75258]:     </cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <power_management>
Nov 14 12:32:09 user nova-compute[75258]:       <suspend_mem/>
Nov 14 12:32:09 user nova-compute[75258]:       <suspend_disk/>
Nov 14 12:32:09 user nova-compute[75258]:       <suspend_hybrid/>
Nov 14 12:32:09 user nova-compute[75258]:     </power_management>
Nov 14 12:32:09 user nova-compute[75258]:     <iommu support='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <migration_features>
Nov 14 12:32:09 user nova-compute[75258]:       <live/>
Nov 14 12:32:09 user nova-compute[75258]:       <uri_transports>
Nov 14 12:32:09 user nova-compute[75258]:         <uri_transport>tcp</uri_transport>
Nov 14 12:32:09 user nova-compute[75258]:         <uri_transport>rdma</uri_transport>
Nov 14 12:32:09 user nova-compute[75258]:       </uri_transports>
Nov 14 12:32:09 user nova-compute[75258]:     </migration_features>
Nov 14 12:32:09 user nova-compute[75258]:     <topology>
Nov 14 12:32:09 user nova-compute[75258]:       <cells num='2'>
Nov 14 12:32:09 user nova-compute[75258]:         <cell id='0'>
Nov 14 12:32:09 user nova-compute[75258]:           <memory unit='KiB'>8189224</memory>
Nov 14 12:32:09 user nova-compute[75258]:           <pages unit='KiB' size='4'>2047306</pages>
Nov 14 12:32:09 user nova-compute[75258]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 12:32:09 user nova-compute[75258]:           <distances>
Nov 14 12:32:09 user nova-compute[75258]:             <sibling id='0' value='10'/>
Nov 14 12:32:09 user nova-compute[75258]:             <sibling id='1' value='20'/>
Nov 14 12:32:09 user nova-compute[75258]:           </distances>
Nov 14 12:32:09 user nova-compute[75258]:           <cpus num='6'>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Nov 14 12:32:09 user nova-compute[75258]:           </cpus>
Nov 14 12:32:09 user nova-compute[75258]:         </cell>
Nov 14 12:32:09 user nova-compute[75258]:         <cell id='1'>
Nov 14 12:32:09 user nova-compute[75258]:           <memory unit='KiB'>8206460</memory>
Nov 14 12:32:09 user nova-compute[75258]:           <pages unit='KiB' size='4'>2051615</pages>
Nov 14 12:32:09 user nova-compute[75258]:           <pages unit='KiB' size='2048'>0</pages>
Nov 14 12:32:09 user nova-compute[75258]:           <distances>
Nov 14 12:32:09 user nova-compute[75258]:             <sibling id='0' value='20'/>
Nov 14 12:32:09 user nova-compute[75258]:             <sibling id='1' value='10'/>
Nov 14 12:32:09 user nova-compute[75258]:           </distances>
Nov 14 12:32:09 user nova-compute[75258]:           <cpus num='6'>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Nov 14 12:32:09 user nova-compute[75258]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Nov 14 12:32:09 user nova-compute[75258]:           </cpus>
Nov 14 12:32:09 user nova-compute[75258]:         </cell>
Nov 14 12:32:09 user nova-compute[75258]:       </cells>
Nov 14 12:32:09 user nova-compute[75258]:     </topology>
Nov 14 12:32:09 user nova-compute[75258]:     <cache>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Nov 14 12:32:09 user nova-compute[75258]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Nov 14 12:32:09 user nova-compute[75258]:     </cache>
Nov 14 12:32:09 user nova-compute[75258]:     <secmodel>
Nov 14 12:32:09 user nova-compute[75258]:       <model>apparmor</model>
Nov 14 12:32:09 user nova-compute[75258]:       <doi>0</doi>
Nov 14 12:32:09 user nova-compute[75258]:     </secmodel>
Nov 14 12:32:09 user nova-compute[75258]:     <secmodel>
Nov 14 12:32:09 user nova-compute[75258]:       <model>dac</model>
Nov 14 12:32:09 user nova-compute[75258]:       <doi>0</doi>
Nov 14 12:32:09 user nova-compute[75258]:       <baselabel type='kvm'>+64055:+108</baselabel>
Nov 14 12:32:09 user nova-compute[75258]:       <baselabel type='qemu'>+64055:+108</baselabel>
Nov 14 12:32:09 user nova-compute[75258]:     </secmodel>
Nov 14 12:32:09 user nova-compute[75258]:   </host>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='alpha'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>clipper</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='armv6l'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>spitz</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>nuri</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>kzm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sx1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>z2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>tosa</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>n810</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>n800</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>terrier</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>midway</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>microbit</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>verdex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>highbank</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>akita</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>connex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>collie</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='armv7l'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>spitz</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>nuri</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>kzm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sx1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>z2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>tosa</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>n810</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>n800</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>terrier</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>midway</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>microbit</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>verdex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>highbank</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>akita</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>connex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>collie</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='aarch64'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>integratorcp</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>ast2600-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>borzoi</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>spitz</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>nuri</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>romulus-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>npcm750-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>rainier-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps3-an547</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>musca-b1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>versatileab</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>kzm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>musca-a</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>smdkc210</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sx1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>imx25-pdk</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>orangepi-pc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>z2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>tosa</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an500</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mps2-an521</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>sabrelite</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an511</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>canon-a1100</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>realview-eb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>emcraft-sf2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>realview-pb-a8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>sbsa-ref</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>raspi1ap</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>palmetto-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sx1-v1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>n810</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>g220a-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>n800</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>tacoma-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>quanta-gsj</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>versatilepb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>terrier</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mainstone</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>mps3-an524</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>kudo-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>vexpress-a9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>midway</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>musicpal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>lm3s811evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>lm3s6965evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>microbit</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an505</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an385</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>raspi3ap</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>cubieboard</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>verdex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>netduino2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mps2-an386</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>raspi3b</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>raspi2b</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>vexpress-a15</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2'>fuji-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='512'>virt-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>cheetah</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>virt-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>ast2500-evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>highbank</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>akita</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>connex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>netduinoplus2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>collie</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>raspi0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <acpi default='on' toggle='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='cris'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>axis-dev88</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='i686'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>isapc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>microvm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='kvm'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <pae/>
Nov 14 12:32:09 user nova-compute[75258]:       <nonpae/>
Nov 14 12:32:09 user nova-compute[75258]:       <acpi default='on' toggle='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:       <apic default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='m68k'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mcf5208evb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>an5206</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>virt-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>q800</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>virt-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>next-cube</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>virt-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='microblaze'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='microblazeel'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>petalogix-ml605</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='mips'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='16'>malta</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='mipsel'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='16'>malta</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='mips64'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='16'>malta</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>pica61</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>magnum</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='mips64el'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='16'>malta</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='16'>loongson3-virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mipssim</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>pica61</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>magnum</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='16'>boston</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>fuloong2e</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='ppc'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mac99</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>40p</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>taihu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='ppc64'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>taihu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>40p</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mac99</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='ppc64le'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2048'>powernv9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>taihu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='15'>mpc8544ds</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2048'>powernv10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>ppce500</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>40p</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>pegasos2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>bamboo</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>g3beige</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>virtex-ml507</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>mac99</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sam460ex</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>ref405ep</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2048'>powernv8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='riscv32'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='8'>spike</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>opentitan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='8'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='riscv64'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='8'>spike</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='5'>sifive_u</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>shakti_c</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sifive_e</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='8'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='s390x'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='sh4'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>shix</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>r2d</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='sh4eb'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>shix</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>r2d</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='sparc'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>SS-5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>SS-20</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>LX</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>SPARCClassic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>leon3_generic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>SPARCbook</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>SS-4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>SS-600MP</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>SS-10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>Voyager</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='sparc64'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sun4u</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>niagara</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>sun4v</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='x86_64'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>64</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-artful</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>x-remote</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='1'>isapc</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-disco</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-impish</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-focal</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>microvm</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='kvm'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <acpi default='on' toggle='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:       <apic default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='xtensa'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>sim</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>kc705</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>ml605</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx200</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx60</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]:   <guest>
Nov 14 12:32:09 user nova-compute[75258]:     <os_type>hvm</os_type>
Nov 14 12:32:09 user nova-compute[75258]:     <arch name='xtensaeb'>
Nov 14 12:32:09 user nova-compute[75258]:       <wordsize>32</wordsize>
Nov 14 12:32:09 user nova-compute[75258]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='4'>sim</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>kc705</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>ml605</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>ml605-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>virt</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx60-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx200</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx200-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>lx60</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <machine maxCpus='32'>kc705-nommu</machine>
Nov 14 12:32:09 user nova-compute[75258]:       <domain type='qemu'/>
Nov 14 12:32:09 user nova-compute[75258]:     </arch>
Nov 14 12:32:09 user nova-compute[75258]:     <features>
Nov 14 12:32:09 user nova-compute[75258]:       <cpuselection/>
Nov 14 12:32:09 user nova-compute[75258]:       <deviceboot/>
Nov 14 12:32:09 user nova-compute[75258]:       <disksnapshot default='on' toggle='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     </features>
Nov 14 12:32:09 user nova-compute[75258]:   </guest>
Nov 14 12:32:09 user nova-compute[75258]: </capabilities>
Nov 14 12:32:09 user nova-compute[75258]: 
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for armv6l via machine types: {'virt', None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for i686 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-i440fx-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>i686</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='255'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'/>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='lm'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ide</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-q35-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>i686</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='288'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'/>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='lm'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-q35-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>i686</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='288'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'/>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='lm'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-i386</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-i440fx-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>i686</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='255'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'/>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='lm'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ide</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for m68k via machine types: {'virt', None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for ppc64 via machine types: {'powernv', 'pseries', None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for x86_64 via machine types: {'pc', 'q35', 'ubuntu-q35', 'ubuntu'} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-i440fx-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>x86_64</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='255'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>efi</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='invtsc'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='rsba'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ide</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-q35-6.2</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>x86_64</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='288'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>efi</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='invtsc'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='rsba'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-q35-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>x86_64</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='288'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>efi</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='invtsc'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='rsba'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Nov 14 12:32:09 user nova-compute[75258]: <domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:   <path>/usr/bin/qemu-system-x86_64</path>
Nov 14 12:32:09 user nova-compute[75258]:   <domain>kvm</domain>
Nov 14 12:32:09 user nova-compute[75258]:   <machine>pc-i440fx-jammy</machine>
Nov 14 12:32:09 user nova-compute[75258]:   <arch>x86_64</arch>
Nov 14 12:32:09 user nova-compute[75258]:   <vcpu max='255'/>
Nov 14 12:32:09 user nova-compute[75258]:   <iothreads supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:   <os supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='firmware'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>efi</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:     <loader supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>rom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pflash</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='readonly'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>yes</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='secure'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>no</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </loader>
Nov 14 12:32:09 user nova-compute[75258]:   </os>
Nov 14 12:32:09 user nova-compute[75258]:   <cpu>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-passthrough' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='hostPassthroughMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='maximum' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='maximumMigratable'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>on</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>off</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='host-model' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <vendor>Intel</vendor>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ss'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='vmx'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pcid'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='hypervisor'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arat'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='tsc_adjust'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='umip'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='md-clear'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='arch-capabilities'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='invtsc'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibpb'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='ibrs'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-stibp'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='amd-ssbd'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='rsba'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='require' name='pschange-mc-no'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='erms'/>
Nov 14 12:32:09 user nova-compute[75258]:       <feature policy='disable' name='xsaveopt'/>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:     <mode name='custom' supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>qemu64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>qemu32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>phenom</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>pentium</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>n270</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm64</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>kvm32</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>coreduo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>core2duo</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>athlon</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Westmere</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Snowridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Skylake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>SandyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Penryn</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G5</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G4</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G3</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Opteron_G2</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Opteron_G1</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>IvyBridge</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Icelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Haswell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Rome</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-Milan</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC-IBPB</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>EPYC</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Dhyana</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cooperlake</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>Conroe</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Cascadelake-Server</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-noTSX</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell-IBRS</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='no'>Broadwell</model>
Nov 14 12:32:09 user nova-compute[75258]:       <model usable='yes'>486</model>
Nov 14 12:32:09 user nova-compute[75258]:     </mode>
Nov 14 12:32:09 user nova-compute[75258]:   </cpu>
Nov 14 12:32:09 user nova-compute[75258]:   <memoryBacking supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:     <enum name='sourceType'>
Nov 14 12:32:09 user nova-compute[75258]:       <value>file</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>anonymous</value>
Nov 14 12:32:09 user nova-compute[75258]:       <value>memfd</value>
Nov 14 12:32:09 user nova-compute[75258]:     </enum>
Nov 14 12:32:09 user nova-compute[75258]:   </memoryBacking>
Nov 14 12:32:09 user nova-compute[75258]:   <devices>
Nov 14 12:32:09 user nova-compute[75258]:     <disk supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='diskDevice'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>disk</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cdrom</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>floppy</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>lun</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='bus'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ide</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>fdc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sata</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </disk>
Nov 14 12:32:09 user nova-compute[75258]:     <graphics supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='type'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>sdl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vnc</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>spice</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egl-headless</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </graphics>
Nov 14 12:32:09 user nova-compute[75258]:     <video supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='modelType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>cirrus</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>vmvga</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>qxl</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>none</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>bochs</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>ramfb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </video>
Nov 14 12:32:09 user nova-compute[75258]:     <hostdev supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='mode'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>subsystem</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='startupPolicy'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>default</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>mandatory</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>requisite</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>optional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='subsysType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>usb</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>pci</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>scsi</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='capsType'/>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='pciBackend'/>
Nov 14 12:32:09 user nova-compute[75258]:     </hostdev>
Nov 14 12:32:09 user nova-compute[75258]:     <rng supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtio-non-transitional</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>random</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>egd</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>builtin</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </rng>
Nov 14 12:32:09 user nova-compute[75258]:     <filesystem supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='driverType'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>path</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>handle</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>virtiofs</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </filesystem>
Nov 14 12:32:09 user nova-compute[75258]:     <tpm supported='yes'>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='model'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-tis</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>tpm-crb</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:       <enum name='backendModel'>
Nov 14 12:32:09 user nova-compute[75258]:         <value>passthrough</value>
Nov 14 12:32:09 user nova-compute[75258]:         <value>emulator</value>
Nov 14 12:32:09 user nova-compute[75258]:       </enum>
Nov 14 12:32:09 user nova-compute[75258]:     </tpm>
Nov 14 12:32:09 user nova-compute[75258]:   </devices>
Nov 14 12:32:09 user nova-compute[75258]:   <features>
Nov 14 12:32:09 user nova-compute[75258]:     <gic supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:     <vmcoreinfo supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <genid supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backingStoreInput supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <backup supported='yes'/>
Nov 14 12:32:09 user nova-compute[75258]:     <sev supported='no'/>
Nov 14 12:32:09 user nova-compute[75258]:   </features>
Nov 14 12:32:09 user nova-compute[75258]: </domainCapabilities>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=75258) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=75258) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Checking secure boot support for host arch (x86_64) {{(pid=75258) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Checking secure boot support for host arch (x86_64) {{(pid=75258) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Checking secure boot support for host arch (x86_64) {{(pid=75258) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Nov 14 12:32:09 user nova-compute[75258]: INFO nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Secure Boot support detected
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] cpu compare xml: <cpu match="exact">
Nov 14 12:32:09 user nova-compute[75258]:   <model>Nehalem</model>
Nov 14 12:32:09 user nova-compute[75258]: </cpu>
Nov 14 12:32:09 user nova-compute[75258]:  {{(pid=75258) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Nov 14 12:32:09 user nova-compute[75258]: INFO nova.virt.node [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Generated node identity 57b222fc-6379-46c4-a979-ca3142626f72
Nov 14 12:32:09 user nova-compute[75258]: INFO nova.virt.node [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Wrote node identity 57b222fc-6379-46c4-a979-ca3142626f72 to /opt/stack/data/nova/compute_id
Nov 14 12:32:09 user nova-compute[75258]: WARNING nova.compute.manager [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Compute nodes ['57b222fc-6379-46c4-a979-ca3142626f72'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Nov 14 12:32:09 user nova-compute[75258]: INFO nova.compute.manager [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Nov 14 12:32:09 user nova-compute[75258]: WARNING nova.compute.manager [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Nov 14 12:32:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:32:09 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:32:09 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Hypervisor/Node resource view: name=user free_ram=11020MB free_disk=26.098114013671875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:32:09 user nova-compute[75258]: WARNING nova.compute.resource_tracker [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] No compute node record for user:57b222fc-6379-46c4-a979-ca3142626f72: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 57b222fc-6379-46c4-a979-ca3142626f72 could not be found.
Nov 14 12:32:09 user nova-compute[75258]: INFO nova.compute.resource_tracker [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Compute node record created for user:user with uuid: 57b222fc-6379-46c4-a979-ca3142626f72
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:32:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:32:10 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] [req-3442126a-5728-4b45-bed1-51427afac467] Created resource provider record via placement API for resource provider with UUID 57b222fc-6379-46c4-a979-ca3142626f72 and name user.
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=75258) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Nov 14 12:32:10 user nova-compute[75258]: INFO nova.virt.libvirt.host [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] kernel doesn't support AMD SEV
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Libvirt baseline CPU <cpu>
Nov 14 12:32:10 user nova-compute[75258]:   <arch>x86_64</arch>
Nov 14 12:32:10 user nova-compute[75258]:   <model>Nehalem</model>
Nov 14 12:32:10 user nova-compute[75258]:   <vendor>Intel</vendor>
Nov 14 12:32:10 user nova-compute[75258]:   <topology sockets="6" cores="1" threads="1"/>
Nov 14 12:32:10 user nova-compute[75258]: </cpu>
Nov 14 12:32:10 user nova-compute[75258]:  {{(pid=75258) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Updated inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Updating resource provider 57b222fc-6379-46c4-a979-ca3142626f72 generation from 0 to 1 during operation: update_inventory {{(pid=75258) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Updating resource provider 57b222fc-6379-46c4-a979-ca3142626f72 generation from 1 to 2 during operation: update_traits {{(pid=75258) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.620s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.service [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Creating RPC server for service compute {{(pid=75258) start /opt/stack/nova/nova/service.py:182}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.service [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] Join ServiceGroup membership for this service compute {{(pid=75258) start /opt/stack/nova/nova/service.py:199}}
Nov 14 12:32:10 user nova-compute[75258]: DEBUG nova.servicegroup.drivers.db [None req-33f40992-6622-4a72-922e-c0663ed9a465 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=75258) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Nov 14 12:32:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:32:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:33:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:33:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=10471MB free_disk=26.001949310302734GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:33:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:34:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:34:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:34:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:34:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:34:02 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:34:02 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:34:02 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=10359MB free_disk=26.066123962402344GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:34:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.138s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:34:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:34:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:35:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:35:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:35:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:35:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:35:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:35:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:35:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=10356MB free_disk=25.81869888305664GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:35:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.149s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:35:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:35:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:35:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:36:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:36:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:36:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:36:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:05 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9628MB free_disk=25.837284088134766GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:36:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.145s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:09 user nova-compute[75258]: INFO nova.compute.claims [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Claim successful on node user
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.286s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.130s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:09 user nova-compute[75258]: INFO nova.compute.claims [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Claim successful on node user
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Creating image(s)
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "/opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "/opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.policy [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '22f65262614340f69b5125a2b4281feb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd67a066c714c4d0fb2bab5ef1995ddb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.485s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.403s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:10 user nova-compute[75258]: INFO nova.compute.claims [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Claim successful on node user
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.policy [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cef85161135e4a978dd763ae91809be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c593ba588c7f442689362cda037f95f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.part --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.virt.images [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] b293cbf1-70d3-49f7-8a42-771d90e2ec06 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.part /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Creating image(s)
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "/opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.891s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.part /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.converted" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae.converted --force-share --output=json" returned: 0 in 0.164s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.259s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:11 user nova-compute[75258]: INFO oslo.privsep.daemon [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmph4rzxwb6/privsep.sock']
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:11 user sudo[84518]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmph4rzxwb6/privsep.sock
Nov 14 12:36:11 user sudo[84518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Creating image(s)
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:11 user nova-compute[75258]: DEBUG nova.policy [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '807e1725870b4bca88785bd3f81aa06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d45cf00d6749eabfd3bc56b38a5d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Successfully created port: 8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Successfully created port: c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:13 user sudo[84518]: pam_unix(sudo:session): session closed for user root
Nov 14 12:36:13 user nova-compute[75258]: INFO oslo.privsep.daemon [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Spawned new privsep daemon via rootwrap
Nov 14 12:36:13 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 12:36:13 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 12:36:13 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Nov 14 12:36:13 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84541
Nov 14 12:36:13 user nova-compute[75258]: WARNING oslo_privsep.priv_context [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] privsep daemon already running
Nov 14 12:36:13 user nova-compute[75258]: WARNING oslo_privsep.priv_context [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] privsep daemon already running
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.244s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.268s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.239s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Successfully created port: 088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk 1073741824" returned: 0 in 0.057s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.228s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.251s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk 1073741824" returned: 0 in 0.054s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.313s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.569s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Cannot resize image /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Ensure instance console log exists: /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.158s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk 1073741824" returned: 0 in 0.053s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Cannot resize image /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Ensure instance console log exists: /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Cannot resize image /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Ensure instance console log exists: /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Successfully updated port: c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Successfully updated port: 8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquired lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:14 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-changed-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Refreshing instance network info cache due to event network-changed-c7130f86-d364-4030-99bd-cc6c1c668f28. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] Acquiring lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received event network-changed-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Refreshing instance network info cache due to event network-changed-8d2087ad-f1d3-40df-84bf-73b92e55f08d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] Acquiring lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updating instance_info_cache with network_info: [{"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Releasing lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Instance network_info: |[{"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] Acquired lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.neutron [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Refreshing network info cache for port 8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Start _get_guest_xml network_info=[{"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:15 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:15 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Successfully updated port: 088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-597089404',display_name='tempest-DeleteServersTestJSON-server-597089404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-597089404',id=1,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d67a066c714c4d0fb2bab5ef1995ddb5',ramdisk_id='',reservation_id='r-m80pk2tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1772678287',owner_user_name='tempest-DeleteServersTestJSON-1772678287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:10Z,user_data=None,user_id='22f65262614340f69b5125a2b4281feb',uuid=3fc117a2-be77-4cdb-b834-0e4a4d5da581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Converting VIF {"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:85:35,bridge_name='br-int',has_traffic_filtering=True,id=8d2087ad-f1d3-40df-84bf-73b92e55f08d,network=Network(c2153b4a-8d19-418f-8bc2-c4e8acec1c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d2087ad-f1') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.objects.instance [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fc117a2-be77-4cdb-b834-0e4a4d5da581 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquired lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:15 user nova-compute[75258]:   <uuid>3fc117a2-be77-4cdb-b834-0e4a4d5da581</uuid>
Nov 14 12:36:15 user nova-compute[75258]:   <name>instance-00000001</name>
Nov 14 12:36:15 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:15 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:15 user nova-compute[75258]:   <metadata>
Nov 14 12:36:15 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:15 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:15 user nova-compute[75258]:       <nova:name>tempest-DeleteServersTestJSON-server-597089404</nova:name>
Nov 14 12:36:15 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:15</nova:creationTime>
Nov 14 12:36:15 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:15 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:15 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:15 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:15 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:15 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:15 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:15 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:15 user nova-compute[75258]:         <nova:user uuid="22f65262614340f69b5125a2b4281feb">tempest-DeleteServersTestJSON-1772678287-project-member</nova:user>
Nov 14 12:36:15 user nova-compute[75258]:         <nova:project uuid="d67a066c714c4d0fb2bab5ef1995ddb5">tempest-DeleteServersTestJSON-1772678287</nova:project>
Nov 14 12:36:15 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:15 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:36:15 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:15 user nova-compute[75258]:         <nova:port uuid="8d2087ad-f1d3-40df-84bf-73b92e55f08d">
Nov 14 12:36:15 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 12:36:15 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:15 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:15 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:15 user nova-compute[75258]:   </metadata>
Nov 14 12:36:15 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:15 user nova-compute[75258]:     <system>
Nov 14 12:36:15 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:15 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:15 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:15 user nova-compute[75258]:       <entry name="serial">3fc117a2-be77-4cdb-b834-0e4a4d5da581</entry>
Nov 14 12:36:15 user nova-compute[75258]:       <entry name="uuid">3fc117a2-be77-4cdb-b834-0e4a4d5da581</entry>
Nov 14 12:36:15 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:15 user nova-compute[75258]:     </system>
Nov 14 12:36:15 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:15 user nova-compute[75258]:   <os>
Nov 14 12:36:15 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:15 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:15 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:15 user nova-compute[75258]:   </os>
Nov 14 12:36:15 user nova-compute[75258]:   <features>
Nov 14 12:36:15 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:15 user nova-compute[75258]:     <apic/>
Nov 14 12:36:15 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:15 user nova-compute[75258]:   </features>
Nov 14 12:36:15 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:15 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:15 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:15 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:15 user nova-compute[75258]:   </clock>
Nov 14 12:36:15 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:15 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:15 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:15 user nova-compute[75258]:   </cpu>
Nov 14 12:36:15 user nova-compute[75258]:   <devices>
Nov 14 12:36:15 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:15 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:15 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk"/>
Nov 14 12:36:15 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:36:15 user nova-compute[75258]:     </disk>
Nov 14 12:36:15 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:15 user nova-compute[75258]:       <mac address="fa:16:3e:69:85:35"/>
Nov 14 12:36:15 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:15 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:15 user nova-compute[75258]:       <target dev="tap8d2087ad-f1"/>
Nov 14 12:36:15 user nova-compute[75258]:     </interface>
Nov 14 12:36:15 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:15 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/console.log" append="off"/>
Nov 14 12:36:15 user nova-compute[75258]:     </serial>
Nov 14 12:36:15 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:15 user nova-compute[75258]:     <video>
Nov 14 12:36:15 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:15 user nova-compute[75258]:     </video>
Nov 14 12:36:15 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:15 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:15 user nova-compute[75258]:     </rng>
Nov 14 12:36:15 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:15 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:15 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:15 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:15 user nova-compute[75258]:   </devices>
Nov 14 12:36:15 user nova-compute[75258]: </domain>
Nov 14 12:36:15 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-597089404',display_name='tempest-DeleteServersTestJSON-server-597089404',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-597089404',id=1,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d67a066c714c4d0fb2bab5ef1995ddb5',ramdisk_id='',reservation_id='r-m80pk2tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1772678287',owner_user_name='tempest-DeleteServersTestJSON-1772678287-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:10Z,user_data=None,user_id='22f65262614340f69b5125a2b4281feb',uuid=3fc117a2-be77-4cdb-b834-0e4a4d5da581,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Converting VIF {"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:85:35,bridge_name='br-int',has_traffic_filtering=True,id=8d2087ad-f1d3-40df-84bf-73b92e55f08d,network=Network(c2153b4a-8d19-418f-8bc2-c4e8acec1c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d2087ad-f1') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG os_vif [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:85:35,bridge_name='br-int',has_traffic_filtering=True,id=8d2087ad-f1d3-40df-84bf-73b92e55f08d,network=Network(c2153b4a-8d19-418f-8bc2-c4e8acec1c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d2087ad-f1') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Created schema index Interface.name {{(pid=75258) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Created schema index Port.name {{(pid=75258) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Created schema index Bridge.name {{(pid=75258) autocreate_indices /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [POLLOUT] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Instance network_info: |[{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] Acquired lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Refreshing network info cache for port c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Start _get_guest_xml network_info=[{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8e04710d-45a1-574d-88d6-1720df74773f', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1441769746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1441769746',id=2,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-khlk59k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:11Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=9de856ad-8adc-46f6-9e9d-ec7ed6eea63c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:d1:95,bridge_name='br-int',has_traffic_filtering=True,id=c7130f86-d364-4030-99bd-cc6c1c668f28,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7130f86-d3') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'pci_devices' on Instance uuid 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: INFO oslo.privsep.daemon [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp81zhp9k7/privsep.sock']
Nov 14 12:36:16 user sudo[84606]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp81zhp9k7/privsep.sock
Nov 14 12:36:16 user sudo[84606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:16 user nova-compute[75258]:   <uuid>9de856ad-8adc-46f6-9e9d-ec7ed6eea63c</uuid>
Nov 14 12:36:16 user nova-compute[75258]:   <name>instance-00000002</name>
Nov 14 12:36:16 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:16 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:16 user nova-compute[75258]:   <metadata>
Nov 14 12:36:16 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:16 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:16 user nova-compute[75258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1441769746</nova:name>
Nov 14 12:36:16 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:16</nova:creationTime>
Nov 14 12:36:16 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:16 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:16 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:16 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:16 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:16 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:16 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:16 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:16 user nova-compute[75258]:         <nova:user uuid="cef85161135e4a978dd763ae91809be9">tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member</nova:user>
Nov 14 12:36:16 user nova-compute[75258]:         <nova:project uuid="c593ba588c7f442689362cda037f95f8">tempest-ServerBootFromVolumeStableRescueTest-1735756414</nova:project>
Nov 14 12:36:16 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:16 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:36:16 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:16 user nova-compute[75258]:         <nova:port uuid="c7130f86-d364-4030-99bd-cc6c1c668f28">
Nov 14 12:36:16 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 12:36:16 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:16 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:16 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:16 user nova-compute[75258]:   </metadata>
Nov 14 12:36:16 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:16 user nova-compute[75258]:     <system>
Nov 14 12:36:16 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:16 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:16 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:16 user nova-compute[75258]:       <entry name="serial">9de856ad-8adc-46f6-9e9d-ec7ed6eea63c</entry>
Nov 14 12:36:16 user nova-compute[75258]:       <entry name="uuid">9de856ad-8adc-46f6-9e9d-ec7ed6eea63c</entry>
Nov 14 12:36:16 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:16 user nova-compute[75258]:     </system>
Nov 14 12:36:16 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:16 user nova-compute[75258]:   <os>
Nov 14 12:36:16 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:16 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:16 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:16 user nova-compute[75258]:   </os>
Nov 14 12:36:16 user nova-compute[75258]:   <features>
Nov 14 12:36:16 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:16 user nova-compute[75258]:     <apic/>
Nov 14 12:36:16 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:16 user nova-compute[75258]:   </features>
Nov 14 12:36:16 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:16 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:16 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:16 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:16 user nova-compute[75258]:   </clock>
Nov 14 12:36:16 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:16 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:16 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:16 user nova-compute[75258]:   </cpu>
Nov 14 12:36:16 user nova-compute[75258]:   <devices>
Nov 14 12:36:16 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:16 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:16 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk"/>
Nov 14 12:36:16 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:36:16 user nova-compute[75258]:     </disk>
Nov 14 12:36:16 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:16 user nova-compute[75258]:       <mac address="fa:16:3e:24:d1:95"/>
Nov 14 12:36:16 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:16 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:16 user nova-compute[75258]:       <target dev="tapc7130f86-d3"/>
Nov 14 12:36:16 user nova-compute[75258]:     </interface>
Nov 14 12:36:16 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:16 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/console.log" append="off"/>
Nov 14 12:36:16 user nova-compute[75258]:     </serial>
Nov 14 12:36:16 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:16 user nova-compute[75258]:     <video>
Nov 14 12:36:16 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:16 user nova-compute[75258]:     </video>
Nov 14 12:36:16 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:16 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:16 user nova-compute[75258]:     </rng>
Nov 14 12:36:16 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:16 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:16 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:16 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:16 user nova-compute[75258]:   </devices>
Nov 14 12:36:16 user nova-compute[75258]: </domain>
Nov 14 12:36:16 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1441769746',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1441769746',id=2,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-khlk59k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:11Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=9de856ad-8adc-46f6-9e9d-ec7ed6eea63c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:24:d1:95,bridge_name='br-int',has_traffic_filtering=True,id=c7130f86-d364-4030-99bd-cc6c1c668f28,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7130f86-d3') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG os_vif [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d1:95,bridge_name='br-int',has_traffic_filtering=True,id=c7130f86-d364-4030-99bd-cc6c1c668f28,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7130f86-d3') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9d7e5e08-781a-574e-bda1-49b843aa79e1', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Releasing lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance network_info: |[{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Start _get_guest_xml network_info=[{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updated VIF entry in instance network info cache for port 8d2087ad-f1d3-40df-84bf-73b92e55f08d. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updating instance_info_cache with network_info: [{"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.objects.instance [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'pci_devices' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9bcb1e67-10e7-4981-ab9b-c57e81999877 req-f716a33b-ce72-4374-9c54-cc6f75a0c96c service nova] Releasing lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:17 user nova-compute[75258]:   <uuid>ac186509-f835-453a-b683-c6d3901babba</uuid>
Nov 14 12:36:17 user nova-compute[75258]:   <name>instance-00000003</name>
Nov 14 12:36:17 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:17 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:17 user nova-compute[75258]:   <metadata>
Nov 14 12:36:17 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:17 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:17 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeTestJSON-server-1628417232</nova:name>
Nov 14 12:36:17 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:17</nova:creationTime>
Nov 14 12:36:17 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:17 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:17 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:17 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:17 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:17 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:17 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:17 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:17 user nova-compute[75258]:         <nova:user uuid="807e1725870b4bca88785bd3f81aa06b">tempest-AttachVolumeTestJSON-528350005-project-member</nova:user>
Nov 14 12:36:17 user nova-compute[75258]:         <nova:project uuid="84d45cf00d6749eabfd3bc56b38a5d4a">tempest-AttachVolumeTestJSON-528350005</nova:project>
Nov 14 12:36:17 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:17 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:36:17 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:17 user nova-compute[75258]:         <nova:port uuid="088cce2a-366c-4b1e-a9cd-f9dba80599b0">
Nov 14 12:36:17 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 12:36:17 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:17 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:17 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:17 user nova-compute[75258]:   </metadata>
Nov 14 12:36:17 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:17 user nova-compute[75258]:     <system>
Nov 14 12:36:17 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:17 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:17 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:17 user nova-compute[75258]:       <entry name="serial">ac186509-f835-453a-b683-c6d3901babba</entry>
Nov 14 12:36:17 user nova-compute[75258]:       <entry name="uuid">ac186509-f835-453a-b683-c6d3901babba</entry>
Nov 14 12:36:17 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:17 user nova-compute[75258]:     </system>
Nov 14 12:36:17 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:17 user nova-compute[75258]:   <os>
Nov 14 12:36:17 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:17 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:17 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:17 user nova-compute[75258]:   </os>
Nov 14 12:36:17 user nova-compute[75258]:   <features>
Nov 14 12:36:17 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:17 user nova-compute[75258]:     <apic/>
Nov 14 12:36:17 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:17 user nova-compute[75258]:   </features>
Nov 14 12:36:17 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:17 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:17 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:17 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:17 user nova-compute[75258]:   </clock>
Nov 14 12:36:17 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:17 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:17 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:17 user nova-compute[75258]:   </cpu>
Nov 14 12:36:17 user nova-compute[75258]:   <devices>
Nov 14 12:36:17 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:17 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:17 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk"/>
Nov 14 12:36:17 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:36:17 user nova-compute[75258]:     </disk>
Nov 14 12:36:17 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:17 user nova-compute[75258]:       <mac address="fa:16:3e:5e:d1:fb"/>
Nov 14 12:36:17 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:17 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:17 user nova-compute[75258]:       <target dev="tap088cce2a-36"/>
Nov 14 12:36:17 user nova-compute[75258]:     </interface>
Nov 14 12:36:17 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:17 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/console.log" append="off"/>
Nov 14 12:36:17 user nova-compute[75258]:     </serial>
Nov 14 12:36:17 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:17 user nova-compute[75258]:     <video>
Nov 14 12:36:17 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:17 user nova-compute[75258]:     </video>
Nov 14 12:36:17 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:17 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:17 user nova-compute[75258]:     </rng>
Nov 14 12:36:17 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:17 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:17 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:17 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:17 user nova-compute[75258]:   </devices>
Nov 14 12:36:17 user nova-compute[75258]: </domain>
Nov 14 12:36:17 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG os_vif [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1d275ba-3ffa-5676-9a4e-6918f5a8ad5c', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-changed-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Refreshing instance network info cache due to event network-changed-088cce2a-366c-4b1e-a9cd-f9dba80599b0. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] Acquiring lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] Acquired lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Refreshing network info cache for port 088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:17 user sudo[84606]: pam_unix(sudo:session): session closed for user root
Nov 14 12:36:17 user nova-compute[75258]: INFO oslo.privsep.daemon [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Spawned new privsep daemon via rootwrap
Nov 14 12:36:17 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 12:36:17 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 12:36:17 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Nov 14 12:36:17 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84615
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updated VIF entry in instance network info cache for port c7130f86-d364-4030-99bd-cc6c1c668f28. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:17 user nova-compute[75258]: WARNING oslo_privsep.priv_context [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] privsep daemon already running
Nov 14 12:36:17 user nova-compute[75258]: WARNING oslo_privsep.priv_context [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] privsep daemon already running
Nov 14 12:36:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a982c2a-b0b7-48fe-9a80-2b1fa0a21653 req-edd0fa14-a85b-4b1f-98b9-3844c598d5a0 service nova] Releasing lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Updated VIF entry in instance network info cache for port 088cce2a-366c-4b1e-a9cd-f9dba80599b0. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6282f293-f73a-40ea-b2bf-9c7ee57eda9c req-d12ed353-7d96-4596-997a-9a0e121e37ec service nova] Releasing lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap088cce2a-36, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap088cce2a-36, col_values=(('qos', UUID('e7e2888a-3b82-4877-875c-d90842bc6149')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap088cce2a-36, col_values=(('external_ids', {'iface-id': '088cce2a-366c-4b1e-a9cd-f9dba80599b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:d1:fb', 'vm-uuid': 'ac186509-f835-453a-b683-c6d3901babba'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: INFO os_vif [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36')
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc7130f86-d3, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc7130f86-d3, col_values=(('qos', UUID('27335b2a-8517-486d-ae22-a62c13b48a6b')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc7130f86-d3, col_values=(('external_ids', {'iface-id': 'c7130f86-d364-4030-99bd-cc6c1c668f28', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:24:d1:95', 'vm-uuid': '9de856ad-8adc-46f6-9e9d-ec7ed6eea63c'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: INFO os_vif [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:24:d1:95,bridge_name='br-int',has_traffic_filtering=True,id=c7130f86-d364-4030-99bd-cc6c1c668f28,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7130f86-d3')
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d2087ad-f1, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d2087ad-f1, col_values=(('qos', UUID('a41b2d94-bee1-4f7b-8bd2-fb170a94a086')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d2087ad-f1, col_values=(('external_ids', {'iface-id': '8d2087ad-f1d3-40df-84bf-73b92e55f08d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:85:35', 'vm-uuid': '3fc117a2-be77-4cdb-b834-0e4a4d5da581'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:18 user nova-compute[75258]: INFO os_vif [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:85:35,bridge_name='br-int',has_traffic_filtering=True,id=8d2087ad-f1d3-40df-84bf-73b92e55f08d,network=Network(c2153b4a-8d19-418f-8bc2-c4e8acec1c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d2087ad-f1')
Nov 14 12:36:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No VIF found with MAC fa:16:3e:5e:d1:fb, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No VIF found with MAC fa:16:3e:24:d1:95, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] No VIF found with MAC fa:16:3e:69:85:35, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Instance spawned successfully.
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance spawned successfully.
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Instance spawned successfully.
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:24 user nova-compute[75258]: INFO nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Took 13.68 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:24 user nova-compute[75258]: INFO nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Took 14.63 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:25 user nova-compute[75258]: INFO nova.compute.manager [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Took 15.27 seconds to build instance.
Nov 14 12:36:25 user nova-compute[75258]: INFO nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Took 13.42 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3ab9a7d5-1ab5-4d16-8715-d736a0537446 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.488s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:25 user nova-compute[75258]: INFO nova.compute.manager [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Took 15.62 seconds to build instance.
Nov 14 12:36:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2eab6b53-7732-43b9-b332-dfa29dd8a895 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.165s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:25 user nova-compute[75258]: INFO nova.compute.manager [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Took 15.50 seconds to build instance.
Nov 14 12:36:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bc18c61f-baf3-405e-bb64-31c94f33550e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.642s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:25 user nova-compute[75258]: INFO nova.compute.claims [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Claim successful on node user
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.491s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.policy [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61b84b06ec4247bca42431850be2d0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b09a067539485181c0bd2f6edb4651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Creating image(s)
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "/opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "/opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "/opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.040s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.253s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.308s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk 1073741824" returned: 0 in 0.149s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.466s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.392s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Cannot resize image /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Ensure instance console log exists: /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "489542b7-b3a3-4004-a9c0-69d90a626497" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "489542b7-b3a3-4004-a9c0-69d90a626497" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Successfully created port: f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:28 user nova-compute[75258]: INFO nova.compute.claims [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Claim successful on node user
Nov 14 12:36:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.771s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:29 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.policy [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a1cc10ee97a471680b98fcf53c94173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881b748cca5c4f31b10b931164e5e1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:29 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Creating image(s)
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "/opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "/opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "/opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.276s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Successfully updated port: f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-changed-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Refreshing instance network info cache due to event network-changed-f2a19abe-f21b-4f2e-9f66-ecaa8194805f. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] Acquiring lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] Acquired lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Refreshing network info cache for port f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.238s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk 1073741824" returned: 0 in 0.080s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.324s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.209s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json" returned: 0 in 0.310s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Cannot resize image /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Ensure instance console log exists: /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Successfully created port: e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-65750730-a529-41d6-9842-8c3c1607b734 req-8a652230-aecd-4a2e-9654-5a0889999c70 service nova] Releasing lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquired lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.network.neutron [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updating instance_info_cache with network_info: [{"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Releasing lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Instance network_info: |[{"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Start _get_guest_xml network_info=[{"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:31 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:31 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1251237813',display_name='tempest-VolumesAdminNegativeTest-server-1251237813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1251237813',id=4,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjLql/Jur4U4HM4M1dV5bSNOrNBSrpvTLVqIrl+amHw+xzMG+8humw/3fqlNkFH2DIBmXytL0keCgNvjhpbiZph+zJnj0J61q7p+YBgFrmgQ/VyXMXhIUJbxxEdBuDRFg==',key_name='tempest-keypair-353647684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b09a067539485181c0bd2f6edb4651',ramdisk_id='',reservation_id='r-0f7yln35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-746118338',owner_user_name='tempest-VolumesAdminNegativeTest-746118338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b84b06ec4247bca42431850be2d0c7',uuid=3121053b-59aa-4412-aee7-a4b54d99d50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converting VIF {"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:7a:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a19abe-f2') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.objects.instance [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lazy-loading 'pci_devices' on Instance uuid 3121053b-59aa-4412-aee7-a4b54d99d50d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:31 user nova-compute[75258]:   <uuid>3121053b-59aa-4412-aee7-a4b54d99d50d</uuid>
Nov 14 12:36:31 user nova-compute[75258]:   <name>instance-00000004</name>
Nov 14 12:36:31 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:31 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:31 user nova-compute[75258]:   <metadata>
Nov 14 12:36:31 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:31 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:31 user nova-compute[75258]:       <nova:name>tempest-VolumesAdminNegativeTest-server-1251237813</nova:name>
Nov 14 12:36:31 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:31</nova:creationTime>
Nov 14 12:36:31 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:31 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:31 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:31 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:31 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:31 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:31 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:31 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:31 user nova-compute[75258]:         <nova:user uuid="61b84b06ec4247bca42431850be2d0c7">tempest-VolumesAdminNegativeTest-746118338-project-member</nova:user>
Nov 14 12:36:31 user nova-compute[75258]:         <nova:project uuid="a5b09a067539485181c0bd2f6edb4651">tempest-VolumesAdminNegativeTest-746118338</nova:project>
Nov 14 12:36:31 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:31 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:36:31 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:31 user nova-compute[75258]:         <nova:port uuid="f2a19abe-f21b-4f2e-9f66-ecaa8194805f">
Nov 14 12:36:31 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:36:31 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:31 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:31 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:31 user nova-compute[75258]:   </metadata>
Nov 14 12:36:31 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:31 user nova-compute[75258]:     <system>
Nov 14 12:36:31 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:31 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:31 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:31 user nova-compute[75258]:       <entry name="serial">3121053b-59aa-4412-aee7-a4b54d99d50d</entry>
Nov 14 12:36:31 user nova-compute[75258]:       <entry name="uuid">3121053b-59aa-4412-aee7-a4b54d99d50d</entry>
Nov 14 12:36:31 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:31 user nova-compute[75258]:     </system>
Nov 14 12:36:31 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:31 user nova-compute[75258]:   <os>
Nov 14 12:36:31 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:31 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:31 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:31 user nova-compute[75258]:   </os>
Nov 14 12:36:31 user nova-compute[75258]:   <features>
Nov 14 12:36:31 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:31 user nova-compute[75258]:     <apic/>
Nov 14 12:36:31 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:31 user nova-compute[75258]:   </features>
Nov 14 12:36:31 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:31 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:31 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:31 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:31 user nova-compute[75258]:   </clock>
Nov 14 12:36:31 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:31 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:31 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:31 user nova-compute[75258]:   </cpu>
Nov 14 12:36:31 user nova-compute[75258]:   <devices>
Nov 14 12:36:31 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:31 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:31 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk"/>
Nov 14 12:36:31 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:36:31 user nova-compute[75258]:     </disk>
Nov 14 12:36:31 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:31 user nova-compute[75258]:       <mac address="fa:16:3e:f3:7a:fb"/>
Nov 14 12:36:31 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:31 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:31 user nova-compute[75258]:       <target dev="tapf2a19abe-f2"/>
Nov 14 12:36:31 user nova-compute[75258]:     </interface>
Nov 14 12:36:31 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:31 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/console.log" append="off"/>
Nov 14 12:36:31 user nova-compute[75258]:     </serial>
Nov 14 12:36:31 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:31 user nova-compute[75258]:     <video>
Nov 14 12:36:31 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:31 user nova-compute[75258]:     </video>
Nov 14 12:36:31 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:31 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:31 user nova-compute[75258]:     </rng>
Nov 14 12:36:31 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:31 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:31 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:31 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:31 user nova-compute[75258]:   </devices>
Nov 14 12:36:31 user nova-compute[75258]: </domain>
Nov 14 12:36:31 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1251237813',display_name='tempest-VolumesAdminNegativeTest-server-1251237813',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1251237813',id=4,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjLql/Jur4U4HM4M1dV5bSNOrNBSrpvTLVqIrl+amHw+xzMG+8humw/3fqlNkFH2DIBmXytL0keCgNvjhpbiZph+zJnj0J61q7p+YBgFrmgQ/VyXMXhIUJbxxEdBuDRFg==',key_name='tempest-keypair-353647684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b09a067539485181c0bd2f6edb4651',ramdisk_id='',reservation_id='r-0f7yln35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-746118338',owner_user_name='tempest-VolumesAdminNegativeTest-746118338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b84b06ec4247bca42431850be2d0c7',uuid=3121053b-59aa-4412-aee7-a4b54d99d50d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converting VIF {"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:7a:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a19abe-f2') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG os_vif [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:7a:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a19abe-f2') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f921e7a5-f9f0-5f09-aef4-12efe8d41493', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf2a19abe-f2, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf2a19abe-f2, col_values=(('qos', UUID('39684c13-184d-416a-a292-51733515fac5')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf2a19abe-f2, col_values=(('external_ids', {'iface-id': 'f2a19abe-f21b-4f2e-9f66-ecaa8194805f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:7a:fb', 'vm-uuid': '3121053b-59aa-4412-aee7-a4b54d99d50d'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:31 user nova-compute[75258]: INFO os_vif [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:7a:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a19abe-f2')
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] No VIF found with MAC fa:16:3e:f3:7a:fb, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Successfully updated port: e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "refresh_cache-489542b7-b3a3-4004-a9c0-69d90a626497" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquired lock "refresh_cache-489542b7-b3a3-4004-a9c0-69d90a626497" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received event network-changed-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Refreshing instance network info cache due to event network-changed-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] Acquiring lock "refresh_cache-489542b7-b3a3-4004-a9c0-69d90a626497" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Updating instance_info_cache with network_info: [{"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Releasing lock "refresh_cache-489542b7-b3a3-4004-a9c0-69d90a626497" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Instance network_info: |[{"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] Acquired lock "refresh_cache-489542b7-b3a3-4004-a9c0-69d90a626497" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.network.neutron [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Refreshing network info cache for port e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Start _get_guest_xml network_info=[{"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:34 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:34 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594018747',display_name='tempest-VolumesActionsTest-instance-1594018747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594018747',id=5,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='881b748cca5c4f31b10b931164e5e1aa',ramdisk_id='',reservation_id='r-fraha80i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666751966',owner_user_name='tempest-VolumesActionsTest-1666751966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:29Z,user_data=None,user_id='6a1cc10ee97a471680b98fcf53c94173',uuid=489542b7-b3a3-4004-a9c0-69d90a626497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converting VIF {"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:ab,bridge_name='br-int',has_traffic_filtering=True,id=e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f2ece-ca') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lazy-loading 'pci_devices' on Instance uuid 489542b7-b3a3-4004-a9c0-69d90a626497 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:34 user nova-compute[75258]:   <uuid>489542b7-b3a3-4004-a9c0-69d90a626497</uuid>
Nov 14 12:36:34 user nova-compute[75258]:   <name>instance-00000005</name>
Nov 14 12:36:34 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:34 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:34 user nova-compute[75258]:   <metadata>
Nov 14 12:36:34 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:34 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:34 user nova-compute[75258]:       <nova:name>tempest-VolumesActionsTest-instance-1594018747</nova:name>
Nov 14 12:36:34 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:34</nova:creationTime>
Nov 14 12:36:34 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:34 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:34 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:34 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:34 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:34 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:34 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:34 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:34 user nova-compute[75258]:         <nova:user uuid="6a1cc10ee97a471680b98fcf53c94173">tempest-VolumesActionsTest-1666751966-project-member</nova:user>
Nov 14 12:36:34 user nova-compute[75258]:         <nova:project uuid="881b748cca5c4f31b10b931164e5e1aa">tempest-VolumesActionsTest-1666751966</nova:project>
Nov 14 12:36:34 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:34 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:36:34 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:34 user nova-compute[75258]:         <nova:port uuid="e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd">
Nov 14 12:36:34 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 12:36:34 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:34 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:34 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:34 user nova-compute[75258]:   </metadata>
Nov 14 12:36:34 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:34 user nova-compute[75258]:     <system>
Nov 14 12:36:34 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:34 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:34 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:34 user nova-compute[75258]:       <entry name="serial">489542b7-b3a3-4004-a9c0-69d90a626497</entry>
Nov 14 12:36:34 user nova-compute[75258]:       <entry name="uuid">489542b7-b3a3-4004-a9c0-69d90a626497</entry>
Nov 14 12:36:34 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:34 user nova-compute[75258]:     </system>
Nov 14 12:36:34 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:34 user nova-compute[75258]:   <os>
Nov 14 12:36:34 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:34 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:34 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:34 user nova-compute[75258]:   </os>
Nov 14 12:36:34 user nova-compute[75258]:   <features>
Nov 14 12:36:34 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:34 user nova-compute[75258]:     <apic/>
Nov 14 12:36:34 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:34 user nova-compute[75258]:   </features>
Nov 14 12:36:34 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:34 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:34 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:34 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:34 user nova-compute[75258]:   </clock>
Nov 14 12:36:34 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:34 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:34 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:34 user nova-compute[75258]:   </cpu>
Nov 14 12:36:34 user nova-compute[75258]:   <devices>
Nov 14 12:36:34 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:34 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:34 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk"/>
Nov 14 12:36:34 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:36:34 user nova-compute[75258]:     </disk>
Nov 14 12:36:34 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:34 user nova-compute[75258]:       <mac address="fa:16:3e:9e:ef:ab"/>
Nov 14 12:36:34 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:34 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:34 user nova-compute[75258]:       <target dev="tape34f2ece-ca"/>
Nov 14 12:36:34 user nova-compute[75258]:     </interface>
Nov 14 12:36:34 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:34 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/console.log" append="off"/>
Nov 14 12:36:34 user nova-compute[75258]:     </serial>
Nov 14 12:36:34 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:34 user nova-compute[75258]:     <video>
Nov 14 12:36:34 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:34 user nova-compute[75258]:     </video>
Nov 14 12:36:34 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:34 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:34 user nova-compute[75258]:     </rng>
Nov 14 12:36:34 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:34 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:34 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:34 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:34 user nova-compute[75258]:   </devices>
Nov 14 12:36:34 user nova-compute[75258]: </domain>
Nov 14 12:36:34 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594018747',display_name='tempest-VolumesActionsTest-instance-1594018747',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594018747',id=5,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='881b748cca5c4f31b10b931164e5e1aa',ramdisk_id='',reservation_id='r-fraha80i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666751966',owner_user_name='tempest-VolumesActionsTest-1666751966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:29Z,user_data=None,user_id='6a1cc10ee97a471680b98fcf53c94173',uuid=489542b7-b3a3-4004-a9c0-69d90a626497,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converting VIF {"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:ab,bridge_name='br-int',has_traffic_filtering=True,id=e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f2ece-ca') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG os_vif [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:ab,bridge_name='br-int',has_traffic_filtering=True,id=e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f2ece-ca') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fc199649-ea5f-5593-9739-942b48402989', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape34f2ece-ca, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape34f2ece-ca, col_values=(('qos', UUID('fa349cda-404b-4ad4-bbcc-c13d686b61a6')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape34f2ece-ca, col_values=(('external_ids', {'iface-id': 'e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9e:ef:ab', 'vm-uuid': '489542b7-b3a3-4004-a9c0-69d90a626497'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:34 user nova-compute[75258]: INFO os_vif [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:ab,bridge_name='br-int',has_traffic_filtering=True,id=e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f2ece-ca')
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] No VIF found with MAC fa:16:3e:9e:ef:ab, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Updated VIF entry in instance network info cache for port e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Updating instance_info_cache with network_info: [{"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] No waiting events found dispatching network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:35 user nova-compute[75258]: WARNING nova.compute.manager [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received unexpected event network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f for instance with vm_state building and task_state spawning.
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] No waiting events found dispatching network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:35 user nova-compute[75258]: WARNING nova.compute.manager [req-6f3e06af-03a2-4d6e-92a1-2a627997388b req-ebffe937-5180-4ddb-9fe2-94afde5e4545 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received unexpected event network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f for instance with vm_state building and task_state spawning.
Nov 14 12:36:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-12d1442d-61af-4d87-8377-b14f9e358216 req-71aea224-84b7-4557-8024-8e0d17b363bc service nova] Releasing lock "refresh_cache-489542b7-b3a3-4004-a9c0-69d90a626497" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Instance spawned successfully.
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:35 user nova-compute[75258]: INFO nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Took 9.50 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:36 user nova-compute[75258]: INFO nova.compute.manager [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Took 10.55 seconds to build instance.
Nov 14 12:36:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-230f28d1-48a2-4fd8-9d0a-cea59232d49f tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.952s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:36 user nova-compute[75258]: INFO nova.compute.claims [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Claim successful on node user
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.597s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.network.neutron [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.policy [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f9758dc3df3342948924d8c0b85abd3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b9f769d042e4faa8908f32760ccd869', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Creating image(s)
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "/opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "/opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "/opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "8cfce5d2125002f10be2aa30eb4a76bccdc8da96" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "8cfce5d2125002f10be2aa30eb4a76bccdc8da96" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG nova.network.neutron [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Successfully created port: 80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:38 user nova-compute[75258]: INFO nova.compute.claims [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Claim successful on node user
Nov 14 12:36:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.part --force-share --output=json" returned: 0 in 0.390s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG nova.virt.images [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] 4650c19d-913f-47f6-b78c-41fba6eb31f6 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:36:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.part /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.part /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.converted" returned: 0 in 0.506s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96.converted --force-share --output=json" returned: 0 in 0.426s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "8cfce5d2125002f10be2aa30eb4a76bccdc8da96" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.987s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-a6bbed59-92ed-4df2-985f-9c461aaf01c1 req-9e53309f-b5d0-4068-810a-2afde732895f service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a6bbed59-92ed-4df2-985f-9c461aaf01c1 req-9e53309f-b5d0-4068-810a-2afde732895f service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a6bbed59-92ed-4df2-985f-9c461aaf01c1 req-9e53309f-b5d0-4068-810a-2afde732895f service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a6bbed59-92ed-4df2-985f-9c461aaf01c1 req-9e53309f-b5d0-4068-810a-2afde732895f service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-a6bbed59-92ed-4df2-985f-9c461aaf01c1 req-9e53309f-b5d0-4068-810a-2afde732895f service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:39 user nova-compute[75258]: WARNING nova.compute.manager [req-a6bbed59-92ed-4df2-985f-9c461aaf01c1 req-9e53309f-b5d0-4068-810a-2afde732895f service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state active and task_state None.
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Successfully updated port: 80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.384s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquired lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:39 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Instance spawned successfully.
Nov 14 12:36:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-changed-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Refreshing instance network info cache due to event network-changed-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] Acquiring lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:40 user nova-compute[75258]: INFO nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Took 10.70 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 --force-share --output=json" returned: 0 in 0.412s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "8cfce5d2125002f10be2aa30eb4a76bccdc8da96" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "8cfce5d2125002f10be2aa30eb4a76bccdc8da96" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.policy [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd09eb01d5c6741b4ac32283284df01ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b829e058e44d7cb8eeb158f2b6ea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 --force-share --output=json" returned: 0 in 0.270s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96,backing_fmt=raw /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updating instance_info_cache with network_info: [{"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96,backing_fmt=raw /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk 1073741824" returned: 0 in 0.098s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "8cfce5d2125002f10be2aa30eb4a76bccdc8da96" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.372s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:40 user nova-compute[75258]: INFO nova.compute.manager [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Took 12.51 seconds to build instance.
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Creating image(s)
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Releasing lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Instance network_info: |[{"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] Acquired lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.network.neutron [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Refreshing network info cache for port 80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7b8f6d24-b457-477e-ab26-31e4d979b980 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "489542b7-b3a3-4004-a9c0-69d90a626497" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.759s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 --force-share --output=json" returned: 0 in 0.287s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.257s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json" returned: 0 in 0.318s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Cannot resize image /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Ensure instance console log exists: /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Start _get_guest_xml network_info=[{"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:36:25Z,direct_url=<?>,disk_format='qcow2',id=4650c19d-913f-47f6-b78c-41fba6eb31f6,min_disk=0,min_ram=0,name='',owner='117c76234a414ca782741eef5353eee2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:36:29Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_name': '/dev/sda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'scsi', 'image_id': '4650c19d-913f-47f6-b78c-41fba6eb31f6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:41 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:41 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.295s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:36:25Z,direct_url=<?>,disk_format='qcow2',id=4650c19d-913f-47f6-b78c-41fba6eb31f6,min_disk=0,min_ram=0,name='',owner='117c76234a414ca782741eef5353eee2',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:36:29Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-245524799',display_name='tempest-AttachSCSIVolumeTestJSON-server-245524799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-245524799',id=6,image_ref='4650c19d-913f-47f6-b78c-41fba6eb31f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHleU03DPSJZli4+3GQgOMPg56aRm2Y8uX3ngxNMVzvUgaTEHQjeYi07qCkqDAvaSU4gF3/I3pUKodyVge0gMUmU4KOh7+lZYepIGzBkHPPSY/Bu6M0JuTiX219XMjwupA==',key_name='tempest-keypair-1265328470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b9f769d042e4faa8908f32760ccd869',ramdisk_id='',reservation_id='r-us2rv6a3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4650c19d-913f-47f6-b78c-41fba6eb31f6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1898185931',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1898185931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9758dc3df3342948924d8c0b85abd3b',uuid=f8188411-19c7-4ca9-adb1-3dbf7a994566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Converting VIF {"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5,network=Network(53009b8b-cf02-46a9-b29b-8bbdf217ef0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80453c54-c7') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.objects.instance [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lazy-loading 'pci_devices' on Instance uuid f8188411-19c7-4ca9-adb1-3dbf7a994566 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk 1073741824" returned: 0 in 0.166s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.466s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:41 user nova-compute[75258]:   <uuid>f8188411-19c7-4ca9-adb1-3dbf7a994566</uuid>
Nov 14 12:36:41 user nova-compute[75258]:   <name>instance-00000006</name>
Nov 14 12:36:41 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:41 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:41 user nova-compute[75258]:   <metadata>
Nov 14 12:36:41 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:41 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:41 user nova-compute[75258]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-245524799</nova:name>
Nov 14 12:36:41 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:41</nova:creationTime>
Nov 14 12:36:41 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:41 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:41 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:41 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:41 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:41 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:41 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:41 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:41 user nova-compute[75258]:         <nova:user uuid="f9758dc3df3342948924d8c0b85abd3b">tempest-AttachSCSIVolumeTestJSON-1898185931-project-member</nova:user>
Nov 14 12:36:41 user nova-compute[75258]:         <nova:project uuid="0b9f769d042e4faa8908f32760ccd869">tempest-AttachSCSIVolumeTestJSON-1898185931</nova:project>
Nov 14 12:36:41 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:41 user nova-compute[75258]:       <nova:root type="image" uuid="4650c19d-913f-47f6-b78c-41fba6eb31f6"/>
Nov 14 12:36:41 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:41 user nova-compute[75258]:         <nova:port uuid="80453c54-c7d6-4bf7-8cbd-f9956a9c52d5">
Nov 14 12:36:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 12:36:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:41 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:41 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:41 user nova-compute[75258]:   </metadata>
Nov 14 12:36:41 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:41 user nova-compute[75258]:     <system>
Nov 14 12:36:41 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:41 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:41 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:41 user nova-compute[75258]:       <entry name="serial">f8188411-19c7-4ca9-adb1-3dbf7a994566</entry>
Nov 14 12:36:41 user nova-compute[75258]:       <entry name="uuid">f8188411-19c7-4ca9-adb1-3dbf7a994566</entry>
Nov 14 12:36:41 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:41 user nova-compute[75258]:     </system>
Nov 14 12:36:41 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:41 user nova-compute[75258]:   <os>
Nov 14 12:36:41 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:41 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:41 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:41 user nova-compute[75258]:   </os>
Nov 14 12:36:41 user nova-compute[75258]:   <features>
Nov 14 12:36:41 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:41 user nova-compute[75258]:     <apic/>
Nov 14 12:36:41 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:41 user nova-compute[75258]:   </features>
Nov 14 12:36:41 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:41 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:41 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:41 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:41 user nova-compute[75258]:   </clock>
Nov 14 12:36:41 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:41 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:41 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:41 user nova-compute[75258]:   </cpu>
Nov 14 12:36:41 user nova-compute[75258]:   <devices>
Nov 14 12:36:41 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:41 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:41 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk"/>
Nov 14 12:36:41 user nova-compute[75258]:       <target dev="sda" bus="scsi"/>
Nov 14 12:36:41 user nova-compute[75258]:       <address type="drive" controller="0" unit="0"/>
Nov 14 12:36:41 user nova-compute[75258]:     </disk>
Nov 14 12:36:41 user nova-compute[75258]:     <disk type="file" device="cdrom">
Nov 14 12:36:41 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 12:36:41 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk.config"/>
Nov 14 12:36:41 user nova-compute[75258]:       <target dev="sdb" bus="scsi"/>
Nov 14 12:36:41 user nova-compute[75258]:       <address type="drive" controller="0" unit="1"/>
Nov 14 12:36:41 user nova-compute[75258]:     </disk>
Nov 14 12:36:41 user nova-compute[75258]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Nov 14 12:36:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:41 user nova-compute[75258]:       <mac address="fa:16:3e:d1:03:aa"/>
Nov 14 12:36:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:41 user nova-compute[75258]:       <target dev="tap80453c54-c7"/>
Nov 14 12:36:41 user nova-compute[75258]:     </interface>
Nov 14 12:36:41 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:41 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/console.log" append="off"/>
Nov 14 12:36:41 user nova-compute[75258]:     </serial>
Nov 14 12:36:41 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:41 user nova-compute[75258]:     <video>
Nov 14 12:36:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:41 user nova-compute[75258]:     </video>
Nov 14 12:36:41 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:41 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:41 user nova-compute[75258]:     </rng>
Nov 14 12:36:41 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:41 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:41 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:41 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:41 user nova-compute[75258]:   </devices>
Nov 14 12:36:41 user nova-compute[75258]: </domain>
Nov 14 12:36:41 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-245524799',display_name='tempest-AttachSCSIVolumeTestJSON-server-245524799',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-245524799',id=6,image_ref='4650c19d-913f-47f6-b78c-41fba6eb31f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHleU03DPSJZli4+3GQgOMPg56aRm2Y8uX3ngxNMVzvUgaTEHQjeYi07qCkqDAvaSU4gF3/I3pUKodyVge0gMUmU4KOh7+lZYepIGzBkHPPSY/Bu6M0JuTiX219XMjwupA==',key_name='tempest-keypair-1265328470',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0b9f769d042e4faa8908f32760ccd869',ramdisk_id='',reservation_id='r-us2rv6a3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4650c19d-913f-47f6-b78c-41fba6eb31f6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1898185931',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1898185931-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9758dc3df3342948924d8c0b85abd3b',uuid=f8188411-19c7-4ca9-adb1-3dbf7a994566,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Converting VIF {"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d1:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5,network=Network(53009b8b-cf02-46a9-b29b-8bbdf217ef0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80453c54-c7') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG os_vif [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5,network=Network(53009b8b-cf02-46a9-b29b-8bbdf217ef0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80453c54-c7') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updated VIF entry in instance network info cache for port 80453c54-c7d6-4bf7-8cbd-f9956a9c52d5. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updating instance_info_cache with network_info: [{"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e45dd3d5-3d3b-5522-a6f4-398406c1e3e2', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap80453c54-c7, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap80453c54-c7, col_values=(('qos', UUID('b436bdd2-0b94-4d7b-8e69-8e1a78690937')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap80453c54-c7, col_values=(('external_ids', {'iface-id': '80453c54-c7d6-4bf7-8cbd-f9956a9c52d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d1:03:aa', 'vm-uuid': 'f8188411-19c7-4ca9-adb1-3dbf7a994566'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d320dba6-7bc8-4921-96da-aa13d900ed8e req-586fb010-594e-461e-9c19-2a09f5cd5e06 service nova] Releasing lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:41 user nova-compute[75258]: INFO os_vif [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d1:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5,network=Network(53009b8b-cf02-46a9-b29b-8bbdf217ef0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80453c54-c7')
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.237s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] No BDM found with device name sda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] No VIF found with MAC fa:16:3e:d1:03:aa, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Using config drive
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json" returned: 0 in 0.291s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Cannot resize image /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Ensure instance console log exists: /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-bfd7420b-b18b-47b4-8d99-7db3848933d4 req-c5a84ecb-678f-4aa0-ad10-bb0a9df3c022 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bfd7420b-b18b-47b4-8d99-7db3848933d4 req-c5a84ecb-678f-4aa0-ad10-bb0a9df3c022 service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bfd7420b-b18b-47b4-8d99-7db3848933d4 req-c5a84ecb-678f-4aa0-ad10-bb0a9df3c022 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bfd7420b-b18b-47b4-8d99-7db3848933d4 req-c5a84ecb-678f-4aa0-ad10-bb0a9df3c022 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-bfd7420b-b18b-47b4-8d99-7db3848933d4 req-c5a84ecb-678f-4aa0-ad10-bb0a9df3c022 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:41 user nova-compute[75258]: WARNING nova.compute.manager [req-bfd7420b-b18b-47b4-8d99-7db3848933d4 req-c5a84ecb-678f-4aa0-ad10-bb0a9df3c022 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state active and task_state None.
Nov 14 12:36:42 user nova-compute[75258]: DEBUG nova.network.neutron [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Successfully created port: 84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Creating config drive at /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk.config
Nov 14 12:36:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2vxhul_2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp2vxhul_2" returned: 0 in 0.071s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Successfully updated port: 84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquired lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-changed-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Refreshing instance network info cache due to event network-changed-84f9ac77-622e-413e-9490-b2be292eee05. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] Acquiring lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Releasing lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Instance network_info: |[{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] Acquired lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.network.neutron [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Refreshing network info cache for port 84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Start _get_guest_xml network_info=[{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:45 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:45 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converting VIF {"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:48:6b,bridge_name='br-int',has_traffic_filtering=True,id=84f9ac77-622e-413e-9490-b2be292eee05,network=Network(84136738-b5d0-4361-a57a-20743a8d3d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f9ac77-62') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.objects.instance [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'pci_devices' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:45 user nova-compute[75258]:   <uuid>fda05899-30ea-43b3-9191-f0a4a5bbba4d</uuid>
Nov 14 12:36:45 user nova-compute[75258]:   <name>instance-00000007</name>
Nov 14 12:36:45 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:45 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:45 user nova-compute[75258]:   <metadata>
Nov 14 12:36:45 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:45 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:45 user nova-compute[75258]:       <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:36:45 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:45</nova:creationTime>
Nov 14 12:36:45 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:45 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:45 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:45 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:45 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:45 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:45 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:45 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:45 user nova-compute[75258]:         <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:36:45 user nova-compute[75258]:         <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:36:45 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:45 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:36:45 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:45 user nova-compute[75258]:         <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:36:45 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:36:45 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:45 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:45 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:45 user nova-compute[75258]:   </metadata>
Nov 14 12:36:45 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:45 user nova-compute[75258]:     <system>
Nov 14 12:36:45 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:45 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:45 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:45 user nova-compute[75258]:       <entry name="serial">fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:36:45 user nova-compute[75258]:       <entry name="uuid">fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:36:45 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:45 user nova-compute[75258]:     </system>
Nov 14 12:36:45 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:45 user nova-compute[75258]:   <os>
Nov 14 12:36:45 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:45 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:45 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:45 user nova-compute[75258]:   </os>
Nov 14 12:36:45 user nova-compute[75258]:   <features>
Nov 14 12:36:45 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:45 user nova-compute[75258]:     <apic/>
Nov 14 12:36:45 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:45 user nova-compute[75258]:   </features>
Nov 14 12:36:45 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:45 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:45 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:45 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:45 user nova-compute[75258]:   </clock>
Nov 14 12:36:45 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:45 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:45 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:45 user nova-compute[75258]:   </cpu>
Nov 14 12:36:45 user nova-compute[75258]:   <devices>
Nov 14 12:36:45 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:45 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:45 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk"/>
Nov 14 12:36:45 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:36:45 user nova-compute[75258]:     </disk>
Nov 14 12:36:45 user nova-compute[75258]:     <disk type="file" device="cdrom">
Nov 14 12:36:45 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 12:36:45 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config"/>
Nov 14 12:36:45 user nova-compute[75258]:       <target dev="hda" bus="ide"/>
Nov 14 12:36:45 user nova-compute[75258]:     </disk>
Nov 14 12:36:45 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:45 user nova-compute[75258]:       <mac address="fa:16:3e:de:48:6b"/>
Nov 14 12:36:45 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:45 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:45 user nova-compute[75258]:       <target dev="tap84f9ac77-62"/>
Nov 14 12:36:45 user nova-compute[75258]:     </interface>
Nov 14 12:36:45 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:45 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log" append="off"/>
Nov 14 12:36:45 user nova-compute[75258]:     </serial>
Nov 14 12:36:45 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:45 user nova-compute[75258]:     <video>
Nov 14 12:36:45 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:45 user nova-compute[75258]:     </video>
Nov 14 12:36:45 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:45 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:45 user nova-compute[75258]:     </rng>
Nov 14 12:36:45 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:45 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:45 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:45 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:45 user nova-compute[75258]:   </devices>
Nov 14 12:36:45 user nova-compute[75258]: </domain>
Nov 14 12:36:45 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converting VIF {"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:de:48:6b,bridge_name='br-int',has_traffic_filtering=True,id=84f9ac77-622e-413e-9490-b2be292eee05,network=Network(84136738-b5d0-4361-a57a-20743a8d3d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f9ac77-62') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG os_vif [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:48:6b,bridge_name='br-int',has_traffic_filtering=True,id=84f9ac77-622e-413e-9490-b2be292eee05,network=Network(84136738-b5d0-4361-a57a-20743a8d3d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f9ac77-62') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41917e5e-5563-5a30-aaed-dee302ea7378', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap84f9ac77-62, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap84f9ac77-62, col_values=(('qos', UUID('1c3936a3-1b45-4b74-ad9e-575c144eb405')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap84f9ac77-62, col_values=(('external_ids', {'iface-id': '84f9ac77-622e-413e-9490-b2be292eee05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:de:48:6b', 'vm-uuid': 'fda05899-30ea-43b3-9191-f0a4a5bbba4d'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: INFO os_vif [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:de:48:6b,bridge_name='br-int',has_traffic_filtering=True,id=84f9ac77-622e-413e-9490-b2be292eee05,network=Network(84136738-b5d0-4361-a57a-20743a8d3d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f9ac77-62')
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No BDM found with device name hda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No VIF found with MAC fa:16:3e:de:48:6b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Using config drive
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:36:45 user nova-compute[75258]: INFO nova.compute.claims [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Claim successful on node user
Nov 14 12:36:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Creating config drive at /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1wz63oc0 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmp1wz63oc0" returned: 0 in 0.081s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.685s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:36:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updated VIF entry in instance network info cache for port 84f9ac77-622e-413e-9490-b2be292eee05. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6430c40c-a343-4401-81e5-212aa28bccbe req-75de4826-6a88-4398-949b-970113fdc269 service nova] Releasing lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.policy [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '75a39fef861d4c84bc7a420cada8f64b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7cc24bf0e654457e887d0d9d97223317', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-6a1ad14b-d6cf-44ae-9cc1-685f167c0405 req-ac1b91a2-c0b5-4e65-9681-6f8243aea6a2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6a1ad14b-d6cf-44ae-9cc1-685f167c0405 req-ac1b91a2-c0b5-4e65-9681-6f8243aea6a2 service nova] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6a1ad14b-d6cf-44ae-9cc1-685f167c0405 req-ac1b91a2-c0b5-4e65-9681-6f8243aea6a2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6a1ad14b-d6cf-44ae-9cc1-685f167c0405 req-ac1b91a2-c0b5-4e65-9681-6f8243aea6a2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-6a1ad14b-d6cf-44ae-9cc1-685f167c0405 req-ac1b91a2-c0b5-4e65-9681-6f8243aea6a2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] No waiting events found dispatching network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:46 user nova-compute[75258]: WARNING nova.compute.manager [req-6a1ad14b-d6cf-44ae-9cc1-685f167c0405 req-ac1b91a2-c0b5-4e65-9681-6f8243aea6a2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received unexpected event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 for instance with vm_state active and task_state None.
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:36:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Creating image(s)
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "/opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "/opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "/opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.218s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.300s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk 1073741824" returned: 0 in 0.057s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.366s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:47 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Instance spawned successfully.
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:47 user nova-compute[75258]: INFO nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Took 9.78 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.256s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:36:47 user nova-compute[75258]: INFO nova.compute.manager [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Took 10.99 seconds to build instance.
Nov 14 12:36:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-00c3bd4c-2d6a-41fc-9bb5-dc0b36cc74bd tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 11.231s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json" returned: 0 in 0.328s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Cannot resize image /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Ensure instance console log exists: /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Successfully created port: f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-4306a7ee-61c7-4225-8bcf-285d2816d07c req-91d9a124-bcc9-4660-a70a-042159d9116d service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4306a7ee-61c7-4225-8bcf-285d2816d07c req-91d9a124-bcc9-4660-a70a-042159d9116d service nova] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4306a7ee-61c7-4225-8bcf-285d2816d07c req-91d9a124-bcc9-4660-a70a-042159d9116d service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4306a7ee-61c7-4225-8bcf-285d2816d07c req-91d9a124-bcc9-4660-a70a-042159d9116d service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-4306a7ee-61c7-4225-8bcf-285d2816d07c req-91d9a124-bcc9-4660-a70a-042159d9116d service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] No waiting events found dispatching network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:48 user nova-compute[75258]: WARNING nova.compute.manager [req-4306a7ee-61c7-4225-8bcf-285d2816d07c req-91d9a124-bcc9-4660-a70a-042159d9116d service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received unexpected event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 for instance with vm_state active and task_state None.
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Successfully updated port: f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquired lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-changed-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Refreshing instance network info cache due to event network-changed-f08eb35e-122b-42c2-9b2a-b8a2acdc37da. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] Acquiring lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Updating instance_info_cache with network_info: [{"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Releasing lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Instance network_info: |[{"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] Acquired lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Refreshing network info cache for port f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Start _get_guest_xml network_info=[{"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:36:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1733350812',display_name='tempest-VolumesAssistedSnapshotsTest-server-1733350812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1733350812',id=8,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIDdC3uutJgU7Z2RMTSlgNx4J53M89zgwHFe1WwI38sbNIQ4nl/uEIrqWHt5hyQ+Qbq2sq9d/Mz0iGOk9tQybObyt7EbkzehO2emx0qcW/zWtKWackHkl7rpz/fB5iMhw==',key_name='tempest-keypair-435714049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cc24bf0e654457e887d0d9d97223317',ramdisk_id='',reservation_id='r-p0jo85uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1331516700',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1331516700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75a39fef861d4c84bc7a420cada8f64b',uuid=1ec48019-6248-4bcf-8c4d-bb07d135ce3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Converting VIF {"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=f08eb35e-122b-42c2-9b2a-b8a2acdc37da,network=Network(d8442fb2-1b8e-4758-adb3-b69f3db2fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08eb35e-12') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.objects.instance [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lazy-loading 'pci_devices' on Instance uuid 1ec48019-6248-4bcf-8c4d-bb07d135ce3f {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:36:49 user nova-compute[75258]:   <uuid>1ec48019-6248-4bcf-8c4d-bb07d135ce3f</uuid>
Nov 14 12:36:49 user nova-compute[75258]:   <name>instance-00000008</name>
Nov 14 12:36:49 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:36:49 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:36:49 user nova-compute[75258]:   <metadata>
Nov 14 12:36:49 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:36:49 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:36:49 user nova-compute[75258]:       <nova:name>tempest-VolumesAssistedSnapshotsTest-server-1733350812</nova:name>
Nov 14 12:36:49 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:36:49</nova:creationTime>
Nov 14 12:36:49 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:36:49 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:36:49 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:36:49 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:36:49 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:36:49 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:36:49 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:36:49 user nova-compute[75258]:       <nova:owner>
Nov 14 12:36:49 user nova-compute[75258]:         <nova:user uuid="75a39fef861d4c84bc7a420cada8f64b">tempest-VolumesAssistedSnapshotsTest-1331516700-project-member</nova:user>
Nov 14 12:36:49 user nova-compute[75258]:         <nova:project uuid="7cc24bf0e654457e887d0d9d97223317">tempest-VolumesAssistedSnapshotsTest-1331516700</nova:project>
Nov 14 12:36:49 user nova-compute[75258]:       </nova:owner>
Nov 14 12:36:49 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:36:49 user nova-compute[75258]:       <nova:ports>
Nov 14 12:36:49 user nova-compute[75258]:         <nova:port uuid="f08eb35e-122b-42c2-9b2a-b8a2acdc37da">
Nov 14 12:36:49 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 12:36:49 user nova-compute[75258]:         </nova:port>
Nov 14 12:36:49 user nova-compute[75258]:       </nova:ports>
Nov 14 12:36:49 user nova-compute[75258]:     </nova:instance>
Nov 14 12:36:49 user nova-compute[75258]:   </metadata>
Nov 14 12:36:49 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:36:49 user nova-compute[75258]:     <system>
Nov 14 12:36:49 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:36:49 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:36:49 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:36:49 user nova-compute[75258]:       <entry name="serial">1ec48019-6248-4bcf-8c4d-bb07d135ce3f</entry>
Nov 14 12:36:49 user nova-compute[75258]:       <entry name="uuid">1ec48019-6248-4bcf-8c4d-bb07d135ce3f</entry>
Nov 14 12:36:49 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:36:49 user nova-compute[75258]:     </system>
Nov 14 12:36:49 user nova-compute[75258]:   </sysinfo>
Nov 14 12:36:49 user nova-compute[75258]:   <os>
Nov 14 12:36:49 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:36:49 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:36:49 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:36:49 user nova-compute[75258]:   </os>
Nov 14 12:36:49 user nova-compute[75258]:   <features>
Nov 14 12:36:49 user nova-compute[75258]:     <acpi/>
Nov 14 12:36:49 user nova-compute[75258]:     <apic/>
Nov 14 12:36:49 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:36:49 user nova-compute[75258]:   </features>
Nov 14 12:36:49 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:36:49 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:36:49 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:36:49 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:36:49 user nova-compute[75258]:   </clock>
Nov 14 12:36:49 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:36:49 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:36:49 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:36:49 user nova-compute[75258]:   </cpu>
Nov 14 12:36:49 user nova-compute[75258]:   <devices>
Nov 14 12:36:49 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:36:49 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:36:49 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk"/>
Nov 14 12:36:49 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:36:49 user nova-compute[75258]:     </disk>
Nov 14 12:36:49 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:36:49 user nova-compute[75258]:       <mac address="fa:16:3e:75:b6:6b"/>
Nov 14 12:36:49 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:49 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:36:49 user nova-compute[75258]:       <target dev="tapf08eb35e-12"/>
Nov 14 12:36:49 user nova-compute[75258]:     </interface>
Nov 14 12:36:49 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:36:49 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/console.log" append="off"/>
Nov 14 12:36:49 user nova-compute[75258]:     </serial>
Nov 14 12:36:49 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:36:49 user nova-compute[75258]:     <video>
Nov 14 12:36:49 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:36:49 user nova-compute[75258]:     </video>
Nov 14 12:36:49 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:36:49 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:36:49 user nova-compute[75258]:     </rng>
Nov 14 12:36:49 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:36:49 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:36:49 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:36:49 user nova-compute[75258]:     </memballoon>
Nov 14 12:36:49 user nova-compute[75258]:   </devices>
Nov 14 12:36:49 user nova-compute[75258]: </domain>
Nov 14 12:36:49 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1733350812',display_name='tempest-VolumesAssistedSnapshotsTest-server-1733350812',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1733350812',id=8,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIDdC3uutJgU7Z2RMTSlgNx4J53M89zgwHFe1WwI38sbNIQ4nl/uEIrqWHt5hyQ+Qbq2sq9d/Mz0iGOk9tQybObyt7EbkzehO2emx0qcW/zWtKWackHkl7rpz/fB5iMhw==',key_name='tempest-keypair-435714049',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7cc24bf0e654457e887d0d9d97223317',ramdisk_id='',reservation_id='r-p0jo85uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1331516700',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1331516700-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75a39fef861d4c84bc7a420cada8f64b',uuid=1ec48019-6248-4bcf-8c4d-bb07d135ce3f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Converting VIF {"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:75:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=f08eb35e-122b-42c2-9b2a-b8a2acdc37da,network=Network(d8442fb2-1b8e-4758-adb3-b69f3db2fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08eb35e-12') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG os_vif [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=f08eb35e-122b-42c2-9b2a-b8a2acdc37da,network=Network(d8442fb2-1b8e-4758-adb3-b69f3db2fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08eb35e-12') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5601210b-1acf-539f-ba65-3d957e393aba', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf08eb35e-12, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf08eb35e-12, col_values=(('qos', UUID('063e2be1-9826-4f91-885d-c57f3565b2b5')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf08eb35e-12, col_values=(('external_ids', {'iface-id': 'f08eb35e-122b-42c2-9b2a-b8a2acdc37da', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:75:b6:6b', 'vm-uuid': '1ec48019-6248-4bcf-8c4d-bb07d135ce3f'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:49 user nova-compute[75258]: INFO os_vif [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:75:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=f08eb35e-122b-42c2-9b2a-b8a2acdc37da,network=Network(d8442fb2-1b8e-4758-adb3-b69f3db2fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08eb35e-12')
Nov 14 12:36:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] No VIF found with MAC fa:16:3e:75:b6:6b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:50 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Instance spawned successfully.
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:50 user nova-compute[75258]: INFO nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Took 9.83 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:50 user nova-compute[75258]: INFO nova.compute.manager [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Took 12.18 seconds to build instance.
Nov 14 12:36:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-94759cd3-376c-4b06-8179-b7cf05cc847a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.928s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Updated VIF entry in instance network info cache for port f08eb35e-122b-42c2-9b2a-b8a2acdc37da. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Updating instance_info_cache with network_info: [{"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:36:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f391911-f50f-413c-995d-42e62a5734bd req-1710ecd0-2582-4807-853f-675eba1090b4 service nova] Releasing lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:36:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-9dcd7873-8397-4018-ad3e-24a7c85576f3 req-617e71a7-22ce-4b49-bd69-500b8cc80c67 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received event network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9dcd7873-8397-4018-ad3e-24a7c85576f3 req-617e71a7-22ce-4b49-bd69-500b8cc80c67 service nova] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9dcd7873-8397-4018-ad3e-24a7c85576f3 req-617e71a7-22ce-4b49-bd69-500b8cc80c67 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9dcd7873-8397-4018-ad3e-24a7c85576f3 req-617e71a7-22ce-4b49-bd69-500b8cc80c67 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-9dcd7873-8397-4018-ad3e-24a7c85576f3 req-617e71a7-22ce-4b49-bd69-500b8cc80c67 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] No waiting events found dispatching network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:53 user nova-compute[75258]: WARNING nova.compute.manager [req-9dcd7873-8397-4018-ad3e-24a7c85576f3 req-617e71a7-22ce-4b49-bd69-500b8cc80c67 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received unexpected event network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d for instance with vm_state active and task_state None.
Nov 14 12:36:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-07d318ae-9c54-49c3-994c-6eabeb13e169 req-79eb27d2-7ef7-49c5-81aa-509c2fb52c20 service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received event network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-07d318ae-9c54-49c3-994c-6eabeb13e169 req-79eb27d2-7ef7-49c5-81aa-509c2fb52c20 service nova] Acquiring lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-07d318ae-9c54-49c3-994c-6eabeb13e169 req-79eb27d2-7ef7-49c5-81aa-509c2fb52c20 service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-07d318ae-9c54-49c3-994c-6eabeb13e169 req-79eb27d2-7ef7-49c5-81aa-509c2fb52c20 service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-07d318ae-9c54-49c3-994c-6eabeb13e169 req-79eb27d2-7ef7-49c5-81aa-509c2fb52c20 service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] No waiting events found dispatching network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:53 user nova-compute[75258]: WARNING nova.compute.manager [req-07d318ae-9c54-49c3-994c-6eabeb13e169 req-79eb27d2-7ef7-49c5-81aa-509c2fb52c20 service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received unexpected event network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd for instance with vm_state active and task_state None.
Nov 14 12:36:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-131f1c12-1095-4c82-84d3-17123e56ae96 req-3d7d07ae-f0b7-4185-9888-8858265b50c3 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-131f1c12-1095-4c82-84d3-17123e56ae96 req-3d7d07ae-f0b7-4185-9888-8858265b50c3 service nova] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-131f1c12-1095-4c82-84d3-17123e56ae96 req-3d7d07ae-f0b7-4185-9888-8858265b50c3 service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-131f1c12-1095-4c82-84d3-17123e56ae96 req-3d7d07ae-f0b7-4185-9888-8858265b50c3 service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-131f1c12-1095-4c82-84d3-17123e56ae96 req-3d7d07ae-f0b7-4185-9888-8858265b50c3 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] No waiting events found dispatching network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:54 user nova-compute[75258]: WARNING nova.compute.manager [req-131f1c12-1095-4c82-84d3-17123e56ae96 req-3d7d07ae-f0b7-4185-9888-8858265b50c3 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received unexpected event network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da for instance with vm_state building and task_state spawning.
Nov 14 12:36:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:36:55 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Instance spawned successfully.
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:36:55 user nova-compute[75258]: INFO nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Took 8.63 seconds to spawn the instance on the hypervisor.
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:36:55 user nova-compute[75258]: INFO nova.compute.manager [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Took 9.91 seconds to build instance.
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701ce7e1-9307-4485-a220-b3530dcf9a73 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.097s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-626d202d-0b9f-4d9e-8075-d4edb49f642c req-baffce5b-0ab2-46f1-905a-845eefdc9c91 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received event network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-626d202d-0b9f-4d9e-8075-d4edb49f642c req-baffce5b-0ab2-46f1-905a-845eefdc9c91 service nova] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-626d202d-0b9f-4d9e-8075-d4edb49f642c req-baffce5b-0ab2-46f1-905a-845eefdc9c91 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-626d202d-0b9f-4d9e-8075-d4edb49f642c req-baffce5b-0ab2-46f1-905a-845eefdc9c91 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-626d202d-0b9f-4d9e-8075-d4edb49f642c req-baffce5b-0ab2-46f1-905a-845eefdc9c91 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] No waiting events found dispatching network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:55 user nova-compute[75258]: WARNING nova.compute.manager [req-626d202d-0b9f-4d9e-8075-d4edb49f642c req-baffce5b-0ab2-46f1-905a-845eefdc9c91 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received unexpected event network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d for instance with vm_state active and task_state None.
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received event network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Acquiring lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] No waiting events found dispatching network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:55 user nova-compute[75258]: WARNING nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received unexpected event network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd for instance with vm_state active and task_state None.
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] No waiting events found dispatching network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:55 user nova-compute[75258]: WARNING nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received unexpected event network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 for instance with vm_state active and task_state None.
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] No waiting events found dispatching network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:55 user nova-compute[75258]: WARNING nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received unexpected event network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 for instance with vm_state active and task_state None.
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:55 user nova-compute[75258]: WARNING nova.compute.manager [req-1973c1fa-3b9c-4656-9d68-56c7941142ec req-dab8e27b-d4db-442a-96ca-785982b12ae9 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received unexpected event network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 for instance with vm_state active and task_state None.
Nov 14 12:36:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-2f63a6ce-fbf3-41d3-88a2-449351965c11 req-332bb0ab-c220-4258-b9f4-98c8dada139a service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2f63a6ce-fbf3-41d3-88a2-449351965c11 req-332bb0ab-c220-4258-b9f4-98c8dada139a service nova] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2f63a6ce-fbf3-41d3-88a2-449351965c11 req-332bb0ab-c220-4258-b9f4-98c8dada139a service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2f63a6ce-fbf3-41d3-88a2-449351965c11 req-332bb0ab-c220-4258-b9f4-98c8dada139a service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-2f63a6ce-fbf3-41d3-88a2-449351965c11 req-332bb0ab-c220-4258-b9f4-98c8dada139a service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] No waiting events found dispatching network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:56 user nova-compute[75258]: WARNING nova.compute.manager [req-2f63a6ce-fbf3-41d3-88a2-449351965c11 req-332bb0ab-c220-4258-b9f4-98c8dada139a service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received unexpected event network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da for instance with vm_state active and task_state None.
Nov 14 12:36:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-00c9740b-0242-4a7b-af67-3e9afc803df7 req-38746ee3-fdf0-479e-b6df-2c7ae5cc7e52 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:36:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-00c9740b-0242-4a7b-af67-3e9afc803df7 req-38746ee3-fdf0-479e-b6df-2c7ae5cc7e52 service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:36:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-00c9740b-0242-4a7b-af67-3e9afc803df7 req-38746ee3-fdf0-479e-b6df-2c7ae5cc7e52 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:36:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-00c9740b-0242-4a7b-af67-3e9afc803df7 req-38746ee3-fdf0-479e-b6df-2c7ae5cc7e52 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:36:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-00c9740b-0242-4a7b-af67-3e9afc803df7 req-38746ee3-fdf0-479e-b6df-2c7ae5cc7e52 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:36:58 user nova-compute[75258]: WARNING nova.compute.manager [req-00c9740b-0242-4a7b-af67-3e9afc803df7 req-38746ee3-fdf0-479e-b6df-2c7ae5cc7e52 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received unexpected event network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 for instance with vm_state active and task_state None.
Nov 14 12:36:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:36:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:37:01 user nova-compute[75258]: INFO nova.compute.claims [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Claim successful on node user
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.540s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.147s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:37:02 user nova-compute[75258]: INFO nova.compute.claims [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Claim successful on node user
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:37:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:37:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:37:02 user nova-compute[75258]: INFO nova.virt.block_device [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Booting with volume 969ba583-c420-4d75-ab00-f175212d21ed at /dev/vda
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.policy [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5b9aaf357d494d30bdc4647a6067e4f0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a998aaf65ac04373a7c84672e57a48de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG os_brick.utils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:37:02 user nova-compute[75258]: INFO oslo.privsep.daemon [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpacttw5ti/privsep.sock']
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:37:02 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:37:02 user sudo[85994]:    stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpacttw5ti/privsep.sock
Nov 14 12:37:02 user sudo[85994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.828s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:37:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.policy [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '591974f996f143ca85705374086be774', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1cbbe47e1c0d4c94bf466112c32c6190', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:37:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Creating image(s)
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "/opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "/opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "/opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.222s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully created port: 74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.212s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk 1073741824" returned: 0 in 0.053s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.206s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Checking if we can resize image /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Cannot resize image /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Ensure instance console log exists: /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully created port: 57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Successfully created port: 7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Skipping network cache update for instance because it is Building. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Skipping network cache update for instance because it is Building. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 3fc117a2-be77-4cdb-b834-0e4a4d5da581 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:37:04 user sudo[85994]: pam_unix(sudo:session): session closed for user root
Nov 14 12:37:04 user nova-compute[75258]: INFO oslo.privsep.daemon [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Spawned new privsep daemon via rootwrap
Nov 14 12:37:04 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep daemon starting
Nov 14 12:37:04 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Nov 14 12:37:04 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Nov 14 12:37:04 user nova-compute[75258]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 86014
Nov 14 12:37:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:04 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce956a2d-b8eb-4709-bf4d-97060c1da57c]: (2,) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully created port: 1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95eaae20-4769-49c4-a9e8-11ee75d27c6a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.nvmeof [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.035s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[647a0976-af02-4fcb-85a9-91af70b00f86]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[697e9cd6-12f5-46d1-9f1d-6b8b05a6d812]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a760c34-04e2-4bdd-9873-9f34b85cfa79]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:37:05 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f89cb95-cf70-4f43-9ea0-881da81e9225]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG os_brick.utils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== get_connector_properties: return (2456ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating existing volume attachment record: 257f5ec5-7771-41d4-9b05-53686e4d04cb {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updating instance_info_cache with network_info: [{"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-3fc117a2-be77-4cdb-b834-0e4a4d5da581" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Successfully updated port: 7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquired lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-changed-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Refreshing instance network info cache due to event network-changed-7c006bb4-98c0-4f9c-9367-d76bd2595e2e. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] Acquiring lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully created port: d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating instance_info_cache with network_info: [{"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Releasing lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Instance network_info: |[{"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] Acquired lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.neutron [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Refreshing network info cache for port 7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Start _get_guest_xml network_info=[{"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:37:06 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:06 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1352315988',display_name='tempest-SnapshotDataIntegrityTests-server-1352315988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1352315988',id=10,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE957PgQRSggN8Dj86LMDAJEmx5ZsvwwbKLz3HalMrOS/jKtfo28/irUdbzNYxEpZAGWabAZuWzb7eMtuCeUM1yXWzQ+nzrwyMe7EkbBQ5aJVyt/6Yur+3v7Owg3LFSDsw==',key_name='tempest-keypair-407325897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cbbe47e1c0d4c94bf466112c32c6190',ramdisk_id='',reservation_id='r-njnaa7mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-620622230',owner_user_name='tempest-SnapshotDataIntegrityTests-620622230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='591974f996f143ca85705374086be774',uuid=80bea81e-2e5a-45d6-814a-44685e6e9d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Converting VIF {"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ff:7e,bridge_name='br-int',has_traffic_filtering=True,id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e,network=Network(17ed6d09-f6ff-49c1-925a-3b359199bdc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c006bb4-98') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'pci_devices' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:37:06 user nova-compute[75258]:   <uuid>80bea81e-2e5a-45d6-814a-44685e6e9d46</uuid>
Nov 14 12:37:06 user nova-compute[75258]:   <name>instance-0000000a</name>
Nov 14 12:37:06 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:37:06 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:37:06 user nova-compute[75258]:   <metadata>
Nov 14 12:37:06 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:37:06 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:37:06 user nova-compute[75258]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-1352315988</nova:name>
Nov 14 12:37:06 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:37:06</nova:creationTime>
Nov 14 12:37:06 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:37:06 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:37:06 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:37:06 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:37:06 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:37:06 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:37:06 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:37:06 user nova-compute[75258]:       <nova:owner>
Nov 14 12:37:06 user nova-compute[75258]:         <nova:user uuid="591974f996f143ca85705374086be774">tempest-SnapshotDataIntegrityTests-620622230-project-member</nova:user>
Nov 14 12:37:06 user nova-compute[75258]:         <nova:project uuid="1cbbe47e1c0d4c94bf466112c32c6190">tempest-SnapshotDataIntegrityTests-620622230</nova:project>
Nov 14 12:37:06 user nova-compute[75258]:       </nova:owner>
Nov 14 12:37:06 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:37:06 user nova-compute[75258]:       <nova:ports>
Nov 14 12:37:06 user nova-compute[75258]:         <nova:port uuid="7c006bb4-98c0-4f9c-9367-d76bd2595e2e">
Nov 14 12:37:06 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 12:37:06 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:06 user nova-compute[75258]:       </nova:ports>
Nov 14 12:37:06 user nova-compute[75258]:     </nova:instance>
Nov 14 12:37:06 user nova-compute[75258]:   </metadata>
Nov 14 12:37:06 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:37:06 user nova-compute[75258]:     <system>
Nov 14 12:37:06 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:37:06 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:37:06 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:37:06 user nova-compute[75258]:       <entry name="serial">80bea81e-2e5a-45d6-814a-44685e6e9d46</entry>
Nov 14 12:37:06 user nova-compute[75258]:       <entry name="uuid">80bea81e-2e5a-45d6-814a-44685e6e9d46</entry>
Nov 14 12:37:06 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:37:06 user nova-compute[75258]:     </system>
Nov 14 12:37:06 user nova-compute[75258]:   </sysinfo>
Nov 14 12:37:06 user nova-compute[75258]:   <os>
Nov 14 12:37:06 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:37:06 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:37:06 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:37:06 user nova-compute[75258]:   </os>
Nov 14 12:37:06 user nova-compute[75258]:   <features>
Nov 14 12:37:06 user nova-compute[75258]:     <acpi/>
Nov 14 12:37:06 user nova-compute[75258]:     <apic/>
Nov 14 12:37:06 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:37:06 user nova-compute[75258]:   </features>
Nov 14 12:37:06 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:37:06 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:37:06 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:37:06 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:37:06 user nova-compute[75258]:   </clock>
Nov 14 12:37:06 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:37:06 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:37:06 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:37:06 user nova-compute[75258]:   </cpu>
Nov 14 12:37:06 user nova-compute[75258]:   <devices>
Nov 14 12:37:06 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:37:06 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:37:06 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk"/>
Nov 14 12:37:06 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:37:06 user nova-compute[75258]:     </disk>
Nov 14 12:37:06 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:06 user nova-compute[75258]:       <mac address="fa:16:3e:e8:ff:7e"/>
Nov 14 12:37:06 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:06 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:06 user nova-compute[75258]:       <target dev="tap7c006bb4-98"/>
Nov 14 12:37:06 user nova-compute[75258]:     </interface>
Nov 14 12:37:06 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:37:06 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/console.log" append="off"/>
Nov 14 12:37:06 user nova-compute[75258]:     </serial>
Nov 14 12:37:06 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:37:06 user nova-compute[75258]:     <video>
Nov 14 12:37:06 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:06 user nova-compute[75258]:     </video>
Nov 14 12:37:06 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:37:06 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:37:06 user nova-compute[75258]:     </rng>
Nov 14 12:37:06 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:37:06 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:37:06 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:37:06 user nova-compute[75258]:     </memballoon>
Nov 14 12:37:06 user nova-compute[75258]:   </devices>
Nov 14 12:37:06 user nova-compute[75258]: </domain>
Nov 14 12:37:06 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1352315988',display_name='tempest-SnapshotDataIntegrityTests-server-1352315988',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1352315988',id=10,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE957PgQRSggN8Dj86LMDAJEmx5ZsvwwbKLz3HalMrOS/jKtfo28/irUdbzNYxEpZAGWabAZuWzb7eMtuCeUM1yXWzQ+nzrwyMe7EkbBQ5aJVyt/6Yur+3v7Owg3LFSDsw==',key_name='tempest-keypair-407325897',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1cbbe47e1c0d4c94bf466112c32c6190',ramdisk_id='',reservation_id='r-njnaa7mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-620622230',owner_user_name='tempest-SnapshotDataIntegrityTests-620622230-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='591974f996f143ca85705374086be774',uuid=80bea81e-2e5a-45d6-814a-44685e6e9d46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Converting VIF {"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ff:7e,bridge_name='br-int',has_traffic_filtering=True,id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e,network=Network(17ed6d09-f6ff-49c1-925a-3b359199bdc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c006bb4-98') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG os_vif [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ff:7e,bridge_name='br-int',has_traffic_filtering=True,id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e,network=Network(17ed6d09-f6ff-49c1-925a-3b359199bdc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c006bb4-98') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8583a8ab-7947-552d-8367-0c096fccedca', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7c006bb4-98, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7c006bb4-98, col_values=(('qos', UUID('13b16f14-eee5-46c4-906d-a8a5804674ed')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7c006bb4-98, col_values=(('external_ids', {'iface-id': '7c006bb4-98c0-4f9c-9367-d76bd2595e2e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:ff:7e', 'vm-uuid': '80bea81e-2e5a-45d6-814a-44685e6e9d46'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:06 user nova-compute[75258]: INFO os_vif [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:ff:7e,bridge_name='br-int',has_traffic_filtering=True,id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e,network=Network(17ed6d09-f6ff-49c1-925a-3b359199bdc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c006bb4-98')
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No VIF found with MAC fa:16:3e:e8:ff:7e, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully created port: e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.neutron [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updated VIF entry in instance network info cache for port 7c006bb4-98c0-4f9c-9367-d76bd2595e2e. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG nova.network.neutron [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating instance_info_cache with network_info: [{"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fe24e105-ec9b-4a38-b036-2aa73e5956e2 req-a24c95b2-89b1-48b2-b194-e44ebf7f06da service nova] Releasing lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully updated port: 74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-74f6b43b-1c34-4e15-ae45-7849287fb46b. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port 74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5eab0440-6e73-4409-811d-8f1d02f4d233 req-cdc2e668-49a2-4442-9fb2-8e64b2b37917 service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully updated port: a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-66f72593-651c-4d38-98d5-e2a8681ca02e req-dd64ab7f-e3fc-4715-99c0-6522fc89063d service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-66f72593-651c-4d38-98d5-e2a8681ca02e req-dd64ab7f-e3fc-4715-99c0-6522fc89063d service nova] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-66f72593-651c-4d38-98d5-e2a8681ca02e req-dd64ab7f-e3fc-4715-99c0-6522fc89063d service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-66f72593-651c-4d38-98d5-e2a8681ca02e req-dd64ab7f-e3fc-4715-99c0-6522fc89063d service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-66f72593-651c-4d38-98d5-e2a8681ca02e req-dd64ab7f-e3fc-4715-99c0-6522fc89063d service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] No waiting events found dispatching network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:08 user nova-compute[75258]: WARNING nova.compute.manager [req-66f72593-651c-4d38-98d5-e2a8681ca02e req-dd64ab7f-e3fc-4715-99c0-6522fc89063d service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received unexpected event network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e for instance with vm_state building and task_state spawning.
Nov 14 12:37:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully updated port: 8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully updated port: 57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-a178791c-2e59-45d7-a0c2-4a7482ee3cef. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-8d3cd6fd-ea40-437f-a094-b021d4d3133e. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port 8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-4d0cef67-1271-48b5-87b5-63b2a0b78e1b req-9825d050-e70f-461a-aabe-dec60c84f202 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4d0cef67-1271-48b5-87b5-63b2a0b78e1b req-9825d050-e70f-461a-aabe-dec60c84f202 service nova] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4d0cef67-1271-48b5-87b5-63b2a0b78e1b req-9825d050-e70f-461a-aabe-dec60c84f202 service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4d0cef67-1271-48b5-87b5-63b2a0b78e1b req-9825d050-e70f-461a-aabe-dec60c84f202 service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-4d0cef67-1271-48b5-87b5-63b2a0b78e1b req-9825d050-e70f-461a-aabe-dec60c84f202 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] No waiting events found dispatching network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:10 user nova-compute[75258]: WARNING nova.compute.manager [req-4d0cef67-1271-48b5-87b5-63b2a0b78e1b req-9825d050-e70f-461a-aabe-dec60c84f202 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received unexpected event network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e for instance with vm_state building and task_state spawning.
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-57365a03-7522-450d-a7dc-3bef486a0eef. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port 57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:37:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Instance spawned successfully.
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully updated port: 1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:10 user nova-compute[75258]: INFO nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Took 7.22 seconds to spawn the instance on the hypervisor.
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:10 user nova-compute[75258]: INFO nova.compute.manager [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Took 8.70 seconds to build instance.
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee4145ac-5d2d-422d-ba97-a94a1be5c3fc tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.839s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4b129dc2-0456-49f7-99aa-714e534b220e req-cdfa3a6a-1e42-448a-acf1-970f51d70633 service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully updated port: d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG nova.network.neutron [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port 1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Successfully updated port: e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:11 user nova-compute[75258]: DEBUG nova.network.neutron [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:11 user nova-compute[75258]: INFO nova.virt.block_device [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Booting with volume 222e7d3c-7457-4188-839d-82abdf5a0913 at /dev/vdb
Nov 14 12:37:12 user nova-compute[75258]: DEBUG os_brick.utils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a92641b-1bc3-409e-a51e-346a346b7f5b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9e2581e-59d0-4ea9-a8b7-d6667f0d805d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2654f97b-b425-46bf-8bcc-b0416832aa1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[16b2fca7-0312-4060-8ee8-631c0abaa0c4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:37:12 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[098b10cd-0b10-4461-828d-0a699a2159fe]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG os_brick.utils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating existing volume attachment record: ea368342-7d2e-4188-adcb-336c7d39600e {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-d833c545-9c52-4de6-b38b-13b22a2af860. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.256s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0d5893fc-95b0-4d82-9f54-877c1134b99c req-64dc2810-722c-4b56-be11-ab61fc0f9772 service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-e73ab2bb-5a2a-4c94-8356-217ead114bef. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581/disk --force-share --output=json" returned: 0 in 0.227s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json" returned: 0 in 0.267s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json" returned: 0 in 0.246s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7370MB free_disk=25.506118774414062GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:37:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3fc117a2-be77-4cdb-b834-0e4a4d5da581 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3121053b-59aa-4412-aee7-a4b54d99d50d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 489542b7-b3a3-4004-a9c0-69d90a626497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance f8188411-19c7-4ca9-adb1-3dbf7a994566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance fda05899-30ea-43b3-9191-f0a4a5bbba4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance b62c235b-e019-47c3-9a0a-73dddd9df33a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [{"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance network_info: |[{"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.network.neutron [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:37:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.950s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updated VIF entry in instance network info cache for port e73ab2bb-5a2a-4c94-8356-217ead114bef. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:37:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [{"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bc6ed7ce-97a4-47bf-aee2-95b8fd50fcef req-9121df47-8c3b-44f9-b3db-dc7ca728994e service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:37:17 user nova-compute[75258]: INFO nova.virt.block_device [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Booting with volume f4840ce4-6574-4c32-b313-ca5249a39850 at /dev/vdc
Nov 14 12:37:17 user nova-compute[75258]: DEBUG os_brick.utils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4a4e86e-e781-4d6c-a47a-a4e4190a17ab]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5bcf067-2f20-47f4-9969-6a505acedb06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[12aa6e7e-c237-4ded-ae22-be59602a1274]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95063fc3-4b75-42b7-be2d-04e7f4340370]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:37:17 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:37:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[911d95eb-72e9-4664-8b9d-e6030b99c5f7]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG os_brick.utils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:37:17 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating existing volume attachment record: e3b4dcc1-09a8-430b-a613-1a8c766a9cd5 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:37:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:37:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Creating image(s)
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Ensure instance console log exists: /opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Start _get_guest_xml network_info=[{"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtjwnMZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b62c235b-e019-47c3-9a0a-73dddd9df33a', 'attached_at': '', 'detached_at': '', 'volume_id': '969ba583-c420-4d75-ab00-f175212d21ed', 'serial': '969ba583-c420-4d75-ab00-f175212d21ed'}, 'device_type': 'disk', 'attachment_id': '257f5ec5-7771-41d4-9b05-53686e4d04cb', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYDyrEpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b62c235b-e019-47c3-9a0a-73dddd9df33a', 'attached_at': '', 'detached_at': '', 'volume_id': '222e7d3c-7457-4188-839d-82abdf5a0913', 'serial': '222e7d3c-7457-4188-839d-82abdf5a0913'}, 'device_type': 'disk', 'attachment_id': 'ea368342-7d2e-4188-adcb-336c7d39600e', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkCEuyhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b62c235b-e019-47c3-9a0a-73dddd9df33a', 'attached_at': '', 'detached_at': '', 'volume_id': 'f4840ce4-6574-4c32-b313-ca5249a39850', 'serial': 'f4840ce4-6574-4c32-b313-ca5249a39850'}, 'device_type': 'disk', 'attachment_id': 'e3b4dcc1-09a8-430b-a613-1a8c766a9cd5', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:37:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:37:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connector [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Factory for ISCSI on None {{(pid=75258) factory /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connector.py:281}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.004s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtjwnMZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:37:24 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:37:24 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:37:24 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc702d2-bcf1-4b43-a322-fc7af7bd862b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:37:24 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[94a5231f-428b-4ebf-9515-c5de5f341251]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed] added
Nov 14 12:37:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab28f8a-b5e1-47b4-a4b8-bb4bbc461c34]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea589bc-375e-446c-90b6-a33370b6edec]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtjwnMZD {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vtjwnMZD" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c77be1c4-f2f7-44dd-aca6-634c3de22130]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vtjwnMZD'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7422ad0-b34c-4305-87ca-9963ecaa00e0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf957444-f54a-479f-85cf-b4b5d588bbc8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 12:37:24 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 12:37:24 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:37:24 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 12:37:24 user nova-compute[75258]: 
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24435fef-24bb-42cb-85a0-f2014fa9d91b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260]
Nov 14 12:37:24 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260] successful.
Nov 14 12:37:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f74a0226-2d76-4094-8092-434ade24206c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11d4a35a-54e5-4755-bf77-bf8dcc62b391]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fff8ace-d3a6-4423-9335-88e21a9d21fa]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:37:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtjwnMZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.322s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== connect_volume: return (1324ms) {'type': 'block', 'scsi_wwn': '26364323566353039', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364323566353039', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYDyrEpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:37:25 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:37:25 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:37:25 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[999750f4-586b-443e-b640-2fda3bb8c3dd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:37:25 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[99caf9a7-d1ff-4983-a9af-78d766faa2c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913] added
Nov 14 12:37:25 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d433355d-e874-4bf6-a2cd-1fbec57ad732]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f87a28d-ff25-41a8-98f6-d232c2f9fdad]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYDyrEpS {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mYDyrEpS" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffba4277-0b0b-46ab-9186-28d75279fc56]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mYDyrEpS'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5708979-87d6-4f43-8b3d-e0a9b8cb5da5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3026db3-b468-4e52-814a-90d0550abc24]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:25 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:25 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[806b889e-8b20-4747-99e5-1d79cd79554c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260]
Nov 14 12:37:25 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260] successful.
Nov 14 12:37:25 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a6776b8-1557-4d01-897d-b478182638e1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[419a11fb-117b-49a2-830a-6b4f74f76a61]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:25 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:37:25 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:25 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:37:25 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e2b65c-bc1a-47f8-9bce-df741c787ba9]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYDyrEpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:37:26 user nova-compute[75258]: INFO nova.compute.claims [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Claim successful on node user
Nov 14 12:37:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26236356262356665', 'path': '/dev/sdc'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26236356262356665', 'path': '/dev/sdc'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkCEuyhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:37:26 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:37:26 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:37:26 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01650d89-7655-487d-a2f0-557caa64939a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:37:26 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[14d13188-371d-47f5-b34b-43dd62fca853]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850] added
Nov 14 12:37:26 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1f1538c-a5c6-4bc5-8f72-520e6f496a45]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfb6df7-4ec1-4bc8-b511-be099346fb1d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.policy [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd81b2cffea334578955e14613341e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6be68d1d7154b8d9ca0a763c1d65617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkCEuyhs {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TkCEuyhs" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9995c2a-dc5a-490b-8ad1-1d2abb442c57]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TkCEuyhs'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef940b49-62a8-4299-b626-0fd12061df68]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:37:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Creating image(s)
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "/opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "/opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "/opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a252f9-80b3-406b-9fa3-54b4f2fc41a5]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:26 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:37:26 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:26 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:37:26 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad219e3-58c2-49a7-9822-dfdf483a735d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260]
Nov 14 12:37:27 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260] successful.
Nov 14 12:37:27 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[794ae508-2be1-4274-91a7-36994a1ba7c5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5854439-f3c8-47c8-badf-28654b3e48f2]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:27 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:37:27 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:37:27 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:37:27 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:37:27 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:37:27 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d9c799-3376-43c1-bbb8-097ab7808b23]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkCEuyhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk 1073741824" returned: 0 in 0.230s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.416s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG nova.network.neutron [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Successfully created port: e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Cannot resize image /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Ensure instance console log exists: /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.388s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '26165613533353237', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165613533353237', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:be,bridge_name='br-int',has_traffic_filtering=True,id=74f6b43b-1c34-4e15-ae45-7849287fb46b,network=Network(a09082b3-9f89-4482-903f-76177ff62733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f6b43b-1c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:34:15,bridge_name='br-int',has_traffic_filtering=True,id=a178791c-2e59-45d7-a0c2-4a7482ee3cef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa178791c-2e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:9b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8d3cd6fd-ea40-437f-a094-b021d4d3133e,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d3cd6fd-ea') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=57365a03-7522-450d-a7dc-3bef486a0eef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57365a03-75') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:65:99,bridge_name='br-int',has_traffic_filtering=True,id=1dd5d8e3-53ee-4b4c-8872-f6ef644359ec,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd5d8e3-53') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f9:15,bridge_name='br-int',has_traffic_filtering=True,id=d833c545-9c52-4de6-b38b-13b22a2af860,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd833c545-9c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ce:70,bridge_name='br-int',has_traffic_filtering=True,id=e73ab2bb-5a2a-4c94-8356-217ead114bef,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73ab2bb-5a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.objects.instance [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lazy-loading 'pci_devices' on Instance uuid b62c235b-e019-47c3-9a0a-73dddd9df33a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:37:28 user nova-compute[75258]:   <uuid>b62c235b-e019-47c3-9a0a-73dddd9df33a</uuid>
Nov 14 12:37:28 user nova-compute[75258]:   <name>instance-00000009</name>
Nov 14 12:37:28 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:37:28 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:37:28 user nova-compute[75258]:   <metadata>
Nov 14 12:37:28 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:37:28 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:name>tempest-device-tagging-server-2098534097</nova:name>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:37:23</nova:creationTime>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:37:28 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:37:28 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:owner>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:user uuid="5b9aaf357d494d30bdc4647a6067e4f0">tempest-TaggedBootDevicesTest_v242-494654149-project-member</nova:user>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:project uuid="a998aaf65ac04373a7c84672e57a48de">tempest-TaggedBootDevicesTest_v242-494654149</nova:project>
Nov 14 12:37:28 user nova-compute[75258]:       </nova:owner>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:ports>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="74f6b43b-1c34-4e15-ae45-7849287fb46b">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="a178791c-2e59-45d7-a0c2-4a7482ee3cef">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.165" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="8d3cd6fd-ea40-437f-a094-b021d4d3133e">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.37" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="57365a03-7522-450d-a7dc-3bef486a0eef">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.189" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="1dd5d8e3-53ee-4b4c-8872-f6ef644359ec">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.13" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="d833c545-9c52-4de6-b38b-13b22a2af860">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="e73ab2bb-5a2a-4c94-8356-217ead114bef">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:       </nova:ports>
Nov 14 12:37:28 user nova-compute[75258]:     </nova:instance>
Nov 14 12:37:28 user nova-compute[75258]:   </metadata>
Nov 14 12:37:28 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:37:28 user nova-compute[75258]:     <system>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="serial">b62c235b-e019-47c3-9a0a-73dddd9df33a</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="uuid">b62c235b-e019-47c3-9a0a-73dddd9df33a</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:37:28 user nova-compute[75258]:     </system>
Nov 14 12:37:28 user nova-compute[75258]:   </sysinfo>
Nov 14 12:37:28 user nova-compute[75258]:   <os>
Nov 14 12:37:28 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:37:28 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:37:28 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:37:28 user nova-compute[75258]:   </os>
Nov 14 12:37:28 user nova-compute[75258]:   <features>
Nov 14 12:37:28 user nova-compute[75258]:     <acpi/>
Nov 14 12:37:28 user nova-compute[75258]:     <apic/>
Nov 14 12:37:28 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:37:28 user nova-compute[75258]:   </features>
Nov 14 12:37:28 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:37:28 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:37:28 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:37:28 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:37:28 user nova-compute[75258]:   </clock>
Nov 14 12:37:28 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:37:28 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:37:28 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:37:28 user nova-compute[75258]:   </cpu>
Nov 14 12:37:28 user nova-compute[75258]:   <devices>
Nov 14 12:37:28 user nova-compute[75258]:     <disk type="file" device="cdrom">
Nov 14 12:37:28 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 12:37:28 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a/disk.config"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="hda" bus="ide"/>
Nov 14 12:37:28 user nova-compute[75258]:     </disk>
Nov 14 12:37:28 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:37:28 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:37:28 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <serial>969ba583-c420-4d75-ab00-f175212d21ed</serial>
Nov 14 12:37:28 user nova-compute[75258]:     </disk>
Nov 14 12:37:28 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:37:28 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:37:28 user nova-compute[75258]:       <source dev="/dev/sdc"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <serial>222e7d3c-7457-4188-839d-82abdf5a0913</serial>
Nov 14 12:37:28 user nova-compute[75258]:     </disk>
Nov 14 12:37:28 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:37:28 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:37:28 user nova-compute[75258]:       <source dev="/dev/sdd"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="vdc" bus="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <serial>f4840ce4-6574-4c32-b313-ca5249a39850</serial>
Nov 14 12:37:28 user nova-compute[75258]:     </disk>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:52:84:be"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tap74f6b43b-1c"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:bd:34:15"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tapa178791c-2e"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:65:9b:2a"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tap8d3cd6fd-ea"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:49:c9:ad"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tap57365a03-75"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:46:65:99"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tap1dd5d8e3-53"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:16:f9:15"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tapd833c545-9c"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:62:ce:70"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tape73ab2bb-5a"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:37:28 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a/console.log" append="off"/>
Nov 14 12:37:28 user nova-compute[75258]:     </serial>
Nov 14 12:37:28 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:37:28 user nova-compute[75258]:     <video>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:     </video>
Nov 14 12:37:28 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:37:28 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:37:28 user nova-compute[75258]:     </rng>
Nov 14 12:37:28 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:37:28 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:37:28 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:37:28 user nova-compute[75258]:     </memballoon>
Nov 14 12:37:28 user nova-compute[75258]:   </devices>
Nov 14 12:37:28 user nova-compute[75258]: </domain>
Nov 14 12:37:28 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:be,bridge_name='br-int',has_traffic_filtering=True,id=74f6b43b-1c34-4e15-ae45-7849287fb46b,network=Network(a09082b3-9f89-4482-903f-76177ff62733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f6b43b-1c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:be,bridge_name='br-int',has_traffic_filtering=True,id=74f6b43b-1c34-4e15-ae45-7849287fb46b,network=Network(a09082b3-9f89-4482-903f-76177ff62733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f6b43b-1c') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '81ac2b15-00da-5b08-9450-943a392ba874', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Successfully updated port: e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap74f6b43b-1c, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap74f6b43b-1c, col_values=(('qos', UUID('7102d8a8-101f-4d87-86fa-c47845d9bbf4')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap74f6b43b-1c, col_values=(('external_ids', {'iface-id': '74f6b43b-1c34-4e15-ae45-7849287fb46b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:84:be', 'vm-uuid': 'b62c235b-e019-47c3-9a0a-73dddd9df33a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquired lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: INFO os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:84:be,bridge_name='br-int',has_traffic_filtering=True,id=74f6b43b-1c34-4e15-ae45-7849287fb46b,network=Network(a09082b3-9f89-4482-903f-76177ff62733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f6b43b-1c')
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:34:15,bridge_name='br-int',has_traffic_filtering=True,id=a178791c-2e59-45d7-a0c2-4a7482ee3cef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa178791c-2e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:34:15,bridge_name='br-int',has_traffic_filtering=True,id=a178791c-2e59-45d7-a0c2-4a7482ee3cef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa178791c-2e') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e3b38c9b-4f15-5515-bfbd-f39facd606c1', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-changed-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Refreshing instance network info cache due to event network-changed-e9c41aa5-5249-4e0b-8acb-4204a526efd2. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] Acquiring lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa178791c-2e, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa178791c-2e, col_values=(('qos', UUID('6345ef03-90c1-4334-9a6b-65179a1e86d3')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa178791c-2e, col_values=(('external_ids', {'iface-id': 'a178791c-2e59-45d7-a0c2-4a7482ee3cef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bd:34:15', 'vm-uuid': 'b62c235b-e019-47c3-9a0a-73dddd9df33a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: INFO os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:34:15,bridge_name='br-int',has_traffic_filtering=True,id=a178791c-2e59-45d7-a0c2-4a7482ee3cef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa178791c-2e')
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:9b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8d3cd6fd-ea40-437f-a094-b021d4d3133e,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d3cd6fd-ea') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8d3cd6fd-ea40-437f-a094-b021d4d3133e,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d3cd6fd-ea') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '778c6582-8c1f-5dbd-b402-c478d972d7bd', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d3cd6fd-ea, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d3cd6fd-ea, col_values=(('qos', UUID('7ac70b72-43e2-4928-8b72-9e7efa3e6364')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d3cd6fd-ea, col_values=(('external_ids', {'iface-id': '8d3cd6fd-ea40-437f-a094-b021d4d3133e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:65:9b:2a', 'vm-uuid': 'b62c235b-e019-47c3-9a0a-73dddd9df33a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: INFO os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8d3cd6fd-ea40-437f-a094-b021d4d3133e,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d3cd6fd-ea')
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=57365a03-7522-450d-a7dc-3bef486a0eef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57365a03-75') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=57365a03-7522-450d-a7dc-3bef486a0eef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57365a03-75') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c29e7b46-6e41-596c-bad6-784eab28ecfc', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap57365a03-75, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap57365a03-75, col_values=(('qos', UUID('72b8b18e-3beb-4a4a-85ff-7b020be5f6d8')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap57365a03-75, col_values=(('external_ids', {'iface-id': '57365a03-7522-450d-a7dc-3bef486a0eef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:49:c9:ad', 'vm-uuid': 'b62c235b-e019-47c3-9a0a-73dddd9df33a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: INFO os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=57365a03-7522-450d-a7dc-3bef486a0eef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57365a03-75')
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:65:99,bridge_name='br-int',has_traffic_filtering=True,id=1dd5d8e3-53ee-4b4c-8872-f6ef644359ec,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd5d8e3-53') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:65:99,bridge_name='br-int',has_traffic_filtering=True,id=1dd5d8e3-53ee-4b4c-8872-f6ef644359ec,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd5d8e3-53') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '224ecd72-85f2-58d6-bcce-77b40639ebd6', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1dd5d8e3-53, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1dd5d8e3-53, col_values=(('qos', UUID('5b0e58d1-ba0a-4a51-b486-e31592d8e01f')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1dd5d8e3-53, col_values=(('external_ids', {'iface-id': '1dd5d8e3-53ee-4b4c-8872-f6ef644359ec', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:46:65:99', 'vm-uuid': 'b62c235b-e019-47c3-9a0a-73dddd9df33a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: INFO os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:65:99,bridge_name='br-int',has_traffic_filtering=True,id=1dd5d8e3-53ee-4b4c-8872-f6ef644359ec,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd5d8e3-53')
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f9:15,bridge_name='br-int',has_traffic_filtering=True,id=d833c545-9c52-4de6-b38b-13b22a2af860,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd833c545-9c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f9:15,bridge_name='br-int',has_traffic_filtering=True,id=d833c545-9c52-4de6-b38b-13b22a2af860,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd833c545-9c') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '596aaab5-e559-57f1-8d90-93f82fe8bd43', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd833c545-9c, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd833c545-9c, col_values=(('qos', UUID('3410a39b-aba8-4d47-b2c7-20a41112b4c0')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd833c545-9c, col_values=(('external_ids', {'iface-id': 'd833c545-9c52-4de6-b38b-13b22a2af860', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:16:f9:15', 'vm-uuid': 'b62c235b-e019-47c3-9a0a-73dddd9df33a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: INFO os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f9:15,bridge_name='br-int',has_traffic_filtering=True,id=d833c545-9c52-4de6-b38b-13b22a2af860,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd833c545-9c')
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ce:70,bridge_name='br-int',has_traffic_filtering=True,id=e73ab2bb-5a2a-4c94-8356-217ead114bef,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73ab2bb-5a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ce:70,bridge_name='br-int',has_traffic_filtering=True,id=e73ab2bb-5a2a-4c94-8356-217ead114bef,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73ab2bb-5a') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eebd3d63-e5a7-5c19-9d38-541096736ea8', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape73ab2bb-5a, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape73ab2bb-5a, col_values=(('qos', UUID('bc8749c6-6357-409d-b7fc-a54fce389fa1')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape73ab2bb-5a, col_values=(('external_ids', {'iface-id': 'e73ab2bb-5a2a-4c94-8356-217ead114bef', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:62:ce:70', 'vm-uuid': 'b62c235b-e019-47c3-9a0a-73dddd9df33a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Updating instance_info_cache with network_info: [{"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Releasing lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Instance network_info: |[{"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] Acquired lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.neutron [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Refreshing network info cache for port e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Start _get_guest_xml network_info=[{"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: INFO os_vif [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ce:70,bridge_name='br-int',has_traffic_filtering=True,id=e73ab2bb-5a2a-4c94-8356-217ead114bef,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73ab2bb-5a')
Nov 14 12:37:28 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:28 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1755229488',display_name='tempest-VolumesSnapshotTestJSON-instance-1755229488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1755229488',id=11,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU6LQ6eJBo2NWThDRYWFv0M2Q+TjnTFTARHFxtgOlI9+WYt/5EgidHl+dkr9jQYAhrRrLvCzp0i7UX2/C6Tyqx9Gqz4UteYOuOoXGy9psEtQGEuFlg1MekASyZRQvN2xA==',key_name='tempest-keypair-206532187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6be68d1d7154b8d9ca0a763c1d65617',ramdisk_id='',reservation_id='r-3qfgsc3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1911480704',owner_user_name='tempest-VolumesSnapshotTestJSON-1911480704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d81b2cffea334578955e14613341e85e',uuid=3c2491e0-6711-4e46-9290-a4e4ad834cab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converting VIF {"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a4:6f,bridge_name='br-int',has_traffic_filtering=True,id=e9c41aa5-5249-4e0b-8acb-4204a526efd2,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c41aa5-52') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'pci_devices' on Instance uuid 3c2491e0-6711-4e46-9290-a4e4ad834cab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:37:28 user nova-compute[75258]:   <uuid>3c2491e0-6711-4e46-9290-a4e4ad834cab</uuid>
Nov 14 12:37:28 user nova-compute[75258]:   <name>instance-0000000b</name>
Nov 14 12:37:28 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:37:28 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:37:28 user nova-compute[75258]:   <metadata>
Nov 14 12:37:28 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:37:28 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1755229488</nova:name>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:37:28</nova:creationTime>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:37:28 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:37:28 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:owner>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:user uuid="d81b2cffea334578955e14613341e85e">tempest-VolumesSnapshotTestJSON-1911480704-project-member</nova:user>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:project uuid="b6be68d1d7154b8d9ca0a763c1d65617">tempest-VolumesSnapshotTestJSON-1911480704</nova:project>
Nov 14 12:37:28 user nova-compute[75258]:       </nova:owner>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:37:28 user nova-compute[75258]:       <nova:ports>
Nov 14 12:37:28 user nova-compute[75258]:         <nova:port uuid="e9c41aa5-5249-4e0b-8acb-4204a526efd2">
Nov 14 12:37:28 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 12:37:28 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:28 user nova-compute[75258]:       </nova:ports>
Nov 14 12:37:28 user nova-compute[75258]:     </nova:instance>
Nov 14 12:37:28 user nova-compute[75258]:   </metadata>
Nov 14 12:37:28 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:37:28 user nova-compute[75258]:     <system>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="serial">3c2491e0-6711-4e46-9290-a4e4ad834cab</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="uuid">3c2491e0-6711-4e46-9290-a4e4ad834cab</entry>
Nov 14 12:37:28 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:37:28 user nova-compute[75258]:     </system>
Nov 14 12:37:28 user nova-compute[75258]:   </sysinfo>
Nov 14 12:37:28 user nova-compute[75258]:   <os>
Nov 14 12:37:28 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:37:28 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:37:28 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:37:28 user nova-compute[75258]:   </os>
Nov 14 12:37:28 user nova-compute[75258]:   <features>
Nov 14 12:37:28 user nova-compute[75258]:     <acpi/>
Nov 14 12:37:28 user nova-compute[75258]:     <apic/>
Nov 14 12:37:28 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:37:28 user nova-compute[75258]:   </features>
Nov 14 12:37:28 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:37:28 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:37:28 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:37:28 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:37:28 user nova-compute[75258]:   </clock>
Nov 14 12:37:28 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:37:28 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:37:28 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:37:28 user nova-compute[75258]:   </cpu>
Nov 14 12:37:28 user nova-compute[75258]:   <devices>
Nov 14 12:37:28 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:37:28 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:37:28 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:     </disk>
Nov 14 12:37:28 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:28 user nova-compute[75258]:       <mac address="fa:16:3e:d5:a4:6f"/>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:28 user nova-compute[75258]:       <target dev="tape9c41aa5-52"/>
Nov 14 12:37:28 user nova-compute[75258]:     </interface>
Nov 14 12:37:28 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:37:28 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/console.log" append="off"/>
Nov 14 12:37:28 user nova-compute[75258]:     </serial>
Nov 14 12:37:28 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:37:28 user nova-compute[75258]:     <video>
Nov 14 12:37:28 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:28 user nova-compute[75258]:     </video>
Nov 14 12:37:28 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:37:28 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:37:28 user nova-compute[75258]:     </rng>
Nov 14 12:37:28 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:37:28 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:37:28 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:37:28 user nova-compute[75258]:     </memballoon>
Nov 14 12:37:28 user nova-compute[75258]:   </devices>
Nov 14 12:37:28 user nova-compute[75258]: </domain>
Nov 14 12:37:28 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1755229488',display_name='tempest-VolumesSnapshotTestJSON-instance-1755229488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1755229488',id=11,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU6LQ6eJBo2NWThDRYWFv0M2Q+TjnTFTARHFxtgOlI9+WYt/5EgidHl+dkr9jQYAhrRrLvCzp0i7UX2/C6Tyqx9Gqz4UteYOuOoXGy9psEtQGEuFlg1MekASyZRQvN2xA==',key_name='tempest-keypair-206532187',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6be68d1d7154b8d9ca0a763c1d65617',ramdisk_id='',reservation_id='r-3qfgsc3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1911480704',owner_user_name='tempest-VolumesSnapshotTestJSON-1911480704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d81b2cffea334578955e14613341e85e',uuid=3c2491e0-6711-4e46-9290-a4e4ad834cab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converting VIF {"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a4:6f,bridge_name='br-int',has_traffic_filtering=True,id=e9c41aa5-5249-4e0b-8acb-4204a526efd2,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c41aa5-52') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG os_vif [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a4:6f,bridge_name='br-int',has_traffic_filtering=True,id=e9c41aa5-5249-4e0b-8acb-4204a526efd2,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c41aa5-52') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4b20d4ed-2552-5ebc-b700-2f5841821b6b', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] No BDM found with device name hda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] No VIF found with MAC fa:16:3e:52:84:be, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:37:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] No VIF found with MAC fa:16:3e:46:65:99, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:37:28 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Using config drive
Nov 14 12:37:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9c41aa5-52, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9c41aa5-52, col_values=(('qos', UUID('37f9a816-d767-4b1d-b34b-a28f405aca0c')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9c41aa5-52, col_values=(('external_ids', {'iface-id': 'e9c41aa5-5249-4e0b-8acb-4204a526efd2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d5:a4:6f', 'vm-uuid': '3c2491e0-6711-4e46-9290-a4e4ad834cab'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:29 user nova-compute[75258]: INFO os_vif [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d5:a4:6f,bridge_name='br-int',has_traffic_filtering=True,id=e9c41aa5-5249-4e0b-8acb-4204a526efd2,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c41aa5-52')
Nov 14 12:37:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No VIF found with MAC fa:16:3e:d5:a4:6f, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:37:29 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Creating config drive at /opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a/disk.config
Nov 14 12:37:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuwmk7x5k {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpuwmk7x5k" returned: 0 in 0.056s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Updated VIF entry in instance network info cache for port e9c41aa5-5249-4e0b-8acb-4204a526efd2. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Updating instance_info_cache with network_info: [{"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-49e67a99-dd0a-445a-b200-7bed827f607c req-a97e2fe4-b628-45c7-abe4-26bb0d7dd406 service nova] Releasing lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-013d994f-c334-44c3-ae96-9631d0debaf7 req-6eba92dc-152a-475d-8a5f-1beb0a1b62ad service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-013d994f-c334-44c3-ae96-9631d0debaf7 req-6eba92dc-152a-475d-8a5f-1beb0a1b62ad service nova] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-013d994f-c334-44c3-ae96-9631d0debaf7 req-6eba92dc-152a-475d-8a5f-1beb0a1b62ad service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-013d994f-c334-44c3-ae96-9631d0debaf7 req-6eba92dc-152a-475d-8a5f-1beb0a1b62ad service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-013d994f-c334-44c3-ae96-9631d0debaf7 req-6eba92dc-152a-475d-8a5f-1beb0a1b62ad service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] No waiting events found dispatching network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:31 user nova-compute[75258]: WARNING nova.compute.manager [req-013d994f-c334-44c3-ae96-9631d0debaf7 req-6eba92dc-152a-475d-8a5f-1beb0a1b62ad service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received unexpected event network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 for instance with vm_state building and task_state spawning.
Nov 14 12:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-cbb6b487-37b1-4274-94f4-ffb490cde0df req-01c58c78-90ab-4e69-92cd-7a42e5c1ffd2 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbb6b487-37b1-4274-94f4-ffb490cde0df req-01c58c78-90ab-4e69-92cd-7a42e5c1ffd2 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbb6b487-37b1-4274-94f4-ffb490cde0df req-01c58c78-90ab-4e69-92cd-7a42e5c1ffd2 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbb6b487-37b1-4274-94f4-ffb490cde0df req-01c58c78-90ab-4e69-92cd-7a42e5c1ffd2 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-cbb6b487-37b1-4274-94f4-ffb490cde0df req-01c58c78-90ab-4e69-92cd-7a42e5c1ffd2 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:32 user nova-compute[75258]: WARNING nova.compute.manager [req-cbb6b487-37b1-4274-94f4-ffb490cde0df req-01c58c78-90ab-4e69-92cd-7a42e5c1ffd2 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b for instance with vm_state building and task_state spawning.
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-ef38bc72-09ea-4ff7-a5d4-b09f837029e4 req-3684a5dd-d145-4280-963e-d82a43fc3e0c service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ef38bc72-09ea-4ff7-a5d4-b09f837029e4 req-3684a5dd-d145-4280-963e-d82a43fc3e0c service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ef38bc72-09ea-4ff7-a5d4-b09f837029e4 req-3684a5dd-d145-4280-963e-d82a43fc3e0c service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ef38bc72-09ea-4ff7-a5d4-b09f837029e4 req-3684a5dd-d145-4280-963e-d82a43fc3e0c service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-ef38bc72-09ea-4ff7-a5d4-b09f837029e4 req-3684a5dd-d145-4280-963e-d82a43fc3e0c service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:32 user nova-compute[75258]: WARNING nova.compute.manager [req-ef38bc72-09ea-4ff7-a5d4-b09f837029e4 req-3684a5dd-d145-4280-963e-d82a43fc3e0c service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef for instance with vm_state building and task_state spawning.
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] No waiting events found dispatching network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:33 user nova-compute[75258]: WARNING nova.compute.manager [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received unexpected event network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 for instance with vm_state building and task_state spawning.
Nov 14 12:37:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:33 user nova-compute[75258]: WARNING nova.compute.manager [req-d7c1ad44-5712-43a4-9dbc-04bcffd238ac req-85969fcc-9909-4b24-b160-f19f0bcdad78 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef for instance with vm_state building and task_state spawning.
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-f9176af1-0872-426a-b09f-bb7238a141ef req-a2385a88-c822-4f77-8af6-2df88a7ace27 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:37:34 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Instance spawned successfully.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:34 user nova-compute[75258]: WARNING nova.compute.manager [req-94907b8c-4b4e-4a0f-9772-2d813df2d32c req-0b9fafab-909e-447d-87e2-bc25b38b7a32 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 for instance with vm_state building and task_state spawning.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:34 user nova-compute[75258]: INFO nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Took 7.95 seconds to spawn the instance on the hypervisor.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:37:34 user nova-compute[75258]: INFO nova.compute.manager [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Took 8.76 seconds to build instance.
Nov 14 12:37:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4564c83-099a-464f-b7fc-00afb8964f9a tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.880s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-7148d34b-c311-4e64-89e1-89077d29fc68 req-df70801f-a4fb-4260-9156-1b873f34d161 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7148d34b-c311-4e64-89e1-89077d29fc68 req-df70801f-a4fb-4260-9156-1b873f34d161 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7148d34b-c311-4e64-89e1-89077d29fc68 req-df70801f-a4fb-4260-9156-1b873f34d161 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7148d34b-c311-4e64-89e1-89077d29fc68 req-df70801f-a4fb-4260-9156-1b873f34d161 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-7148d34b-c311-4e64-89e1-89077d29fc68 req-df70801f-a4fb-4260-9156-1b873f34d161 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:35 user nova-compute[75258]: WARNING nova.compute.manager [req-7148d34b-c311-4e64-89e1-89077d29fc68 req-df70801f-a4fb-4260-9156-1b873f34d161 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef for instance with vm_state building and task_state spawning.
Nov 14 12:37:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:37:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance spawned successfully.
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:36 user nova-compute[75258]: WARNING nova.compute.manager [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef for instance with vm_state building and task_state spawning.
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:36 user nova-compute[75258]: WARNING nova.compute.manager [req-077ae795-0ed5-4d1e-93eb-511778c08d36 req-d6e3323f-422a-480f-9f77-6e7369879b91 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef for instance with vm_state building and task_state spawning.
Nov 14 12:37:36 user nova-compute[75258]: INFO nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Took 12.59 seconds to spawn the instance on the hypervisor.
Nov 14 12:37:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:37:36 user nova-compute[75258]: INFO nova.compute.manager [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Took 35.13 seconds to build instance.
Nov 14 12:37:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-796df1f4-81d2-4596-97bc-52dd1fcf83c9 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 35.269s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:37:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:37:45 user nova-compute[75258]: INFO nova.compute.claims [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Claim successful on node user
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.436s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:37:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.policy [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ddb5010401df4dba8566bec73874370a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd1a340e6d62144b381c8d7b8f59641ad', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:37:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Creating image(s)
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "/opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "/opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.293s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Successfully created port: 789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.205s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk 1073741824" returned: 0 in 0.057s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.269s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Successfully updated port: 789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Cannot resize image /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Ensure instance console log exists: /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquired lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-changed-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Refreshing instance network info cache due to event network-changed-789cac5f-ec82-4949-9568-e0064b11b92a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] Acquiring lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updating instance_info_cache with network_info: [{"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Releasing lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Instance network_info: |[{"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] Acquired lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Refreshing network info cache for port 789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Start _get_guest_xml network_info=[{"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:37:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-424583883',display_name='tempest-TestServerVolumeAttachmentScenario-server-424583883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-424583883',id=12,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwpspkl9wxHI0DoMJPuF/vWWO52IZep5D5MOQXZk3Mn7VJj73ltpkGbkkLc6gdDAyX3AoZFoBEHt9jVAq6Cjr2DeztCxp1N0Dn9X4/ebkX97U8CR0yx4HcG94r4LD66IA==',key_name='tempest-keypair-1051722712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1a340e6d62144b381c8d7b8f59641ad',ramdisk_id='',reservation_id='r-kbtjqmr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1340122816',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1340122816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb5010401df4dba8566bec73874370a',uuid=4cd80282-24f6-4b44-bb13-f9586d478364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Converting VIF {"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=789cac5f-ec82-4949-9568-e0064b11b92a,network=Network(887006f8-c372-4244-936f-8ec305c48bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789cac5f-ec') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.objects.instance [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:37:47 user nova-compute[75258]:   <uuid>4cd80282-24f6-4b44-bb13-f9586d478364</uuid>
Nov 14 12:37:47 user nova-compute[75258]:   <name>instance-0000000c</name>
Nov 14 12:37:47 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:37:47 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:37:47 user nova-compute[75258]:   <metadata>
Nov 14 12:37:47 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:37:47 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:37:47 user nova-compute[75258]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-424583883</nova:name>
Nov 14 12:37:47 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:37:47</nova:creationTime>
Nov 14 12:37:47 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:37:47 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:37:47 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:37:47 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:37:47 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:37:47 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:37:47 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:37:47 user nova-compute[75258]:       <nova:owner>
Nov 14 12:37:47 user nova-compute[75258]:         <nova:user uuid="ddb5010401df4dba8566bec73874370a">tempest-TestServerVolumeAttachmentScenario-1340122816-project-member</nova:user>
Nov 14 12:37:47 user nova-compute[75258]:         <nova:project uuid="d1a340e6d62144b381c8d7b8f59641ad">tempest-TestServerVolumeAttachmentScenario-1340122816</nova:project>
Nov 14 12:37:47 user nova-compute[75258]:       </nova:owner>
Nov 14 12:37:47 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:37:47 user nova-compute[75258]:       <nova:ports>
Nov 14 12:37:47 user nova-compute[75258]:         <nova:port uuid="789cac5f-ec82-4949-9568-e0064b11b92a">
Nov 14 12:37:47 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 12:37:47 user nova-compute[75258]:         </nova:port>
Nov 14 12:37:47 user nova-compute[75258]:       </nova:ports>
Nov 14 12:37:47 user nova-compute[75258]:     </nova:instance>
Nov 14 12:37:47 user nova-compute[75258]:   </metadata>
Nov 14 12:37:47 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:37:47 user nova-compute[75258]:     <system>
Nov 14 12:37:47 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:37:47 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:37:47 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:37:47 user nova-compute[75258]:       <entry name="serial">4cd80282-24f6-4b44-bb13-f9586d478364</entry>
Nov 14 12:37:47 user nova-compute[75258]:       <entry name="uuid">4cd80282-24f6-4b44-bb13-f9586d478364</entry>
Nov 14 12:37:47 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:37:47 user nova-compute[75258]:     </system>
Nov 14 12:37:47 user nova-compute[75258]:   </sysinfo>
Nov 14 12:37:47 user nova-compute[75258]:   <os>
Nov 14 12:37:47 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:37:47 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:37:47 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:37:47 user nova-compute[75258]:   </os>
Nov 14 12:37:47 user nova-compute[75258]:   <features>
Nov 14 12:37:47 user nova-compute[75258]:     <acpi/>
Nov 14 12:37:47 user nova-compute[75258]:     <apic/>
Nov 14 12:37:47 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:37:47 user nova-compute[75258]:   </features>
Nov 14 12:37:47 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:37:47 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:37:47 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:37:47 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:37:47 user nova-compute[75258]:   </clock>
Nov 14 12:37:47 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:37:47 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:37:47 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:37:47 user nova-compute[75258]:   </cpu>
Nov 14 12:37:47 user nova-compute[75258]:   <devices>
Nov 14 12:37:47 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:37:47 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:37:47 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk"/>
Nov 14 12:37:47 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:37:47 user nova-compute[75258]:     </disk>
Nov 14 12:37:47 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:37:47 user nova-compute[75258]:       <mac address="fa:16:3e:48:72:d4"/>
Nov 14 12:37:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:47 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:37:47 user nova-compute[75258]:       <target dev="tap789cac5f-ec"/>
Nov 14 12:37:47 user nova-compute[75258]:     </interface>
Nov 14 12:37:47 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:37:47 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/console.log" append="off"/>
Nov 14 12:37:47 user nova-compute[75258]:     </serial>
Nov 14 12:37:47 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:37:47 user nova-compute[75258]:     <video>
Nov 14 12:37:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:37:47 user nova-compute[75258]:     </video>
Nov 14 12:37:47 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:37:47 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:37:47 user nova-compute[75258]:     </rng>
Nov 14 12:37:47 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:37:47 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:37:47 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:37:47 user nova-compute[75258]:     </memballoon>
Nov 14 12:37:47 user nova-compute[75258]:   </devices>
Nov 14 12:37:47 user nova-compute[75258]: </domain>
Nov 14 12:37:47 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-424583883',display_name='tempest-TestServerVolumeAttachmentScenario-server-424583883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-424583883',id=12,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwpspkl9wxHI0DoMJPuF/vWWO52IZep5D5MOQXZk3Mn7VJj73ltpkGbkkLc6gdDAyX3AoZFoBEHt9jVAq6Cjr2DeztCxp1N0Dn9X4/ebkX97U8CR0yx4HcG94r4LD66IA==',key_name='tempest-keypair-1051722712',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d1a340e6d62144b381c8d7b8f59641ad',ramdisk_id='',reservation_id='r-kbtjqmr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1340122816',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1340122816-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:37:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb5010401df4dba8566bec73874370a',uuid=4cd80282-24f6-4b44-bb13-f9586d478364,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Converting VIF {"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=789cac5f-ec82-4949-9568-e0064b11b92a,network=Network(887006f8-c372-4244-936f-8ec305c48bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789cac5f-ec') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG os_vif [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=789cac5f-ec82-4949-9568-e0064b11b92a,network=Network(887006f8-c372-4244-936f-8ec305c48bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789cac5f-ec') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '32c2e0de-2243-5b5e-afd6-6460c637f2e3', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap789cac5f-ec, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap789cac5f-ec, col_values=(('qos', UUID('bd88bf7c-d8d0-4388-a1fc-75c7c1ebe992')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap789cac5f-ec, col_values=(('external_ids', {'iface-id': '789cac5f-ec82-4949-9568-e0064b11b92a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:72:d4', 'vm-uuid': '4cd80282-24f6-4b44-bb13-f9586d478364'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:47 user nova-compute[75258]: INFO os_vif [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=789cac5f-ec82-4949-9568-e0064b11b92a,network=Network(887006f8-c372-4244-936f-8ec305c48bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789cac5f-ec')
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:37:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No VIF found with MAC fa:16:3e:48:72:d4, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:37:48 user nova-compute[75258]: DEBUG nova.network.neutron [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updated VIF entry in instance network info cache for port 789cac5f-ec82-4949-9568-e0064b11b92a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:37:48 user nova-compute[75258]: DEBUG nova.network.neutron [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updating instance_info_cache with network_info: [{"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:37:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7df475d0-ebbd-45f3-9d0b-c0a5a1e7579b req-35951655-d2fe-4438-a31e-8ff402098cdc service nova] Releasing lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:37:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-6d3e2cb8-c5e6-4970-8b91-221fbb8634dc req-e661d8e8-239f-465d-9ca8-f213c006a935 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6d3e2cb8-c5e6-4970-8b91-221fbb8634dc req-e661d8e8-239f-465d-9ca8-f213c006a935 service nova] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6d3e2cb8-c5e6-4970-8b91-221fbb8634dc req-e661d8e8-239f-465d-9ca8-f213c006a935 service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6d3e2cb8-c5e6-4970-8b91-221fbb8634dc req-e661d8e8-239f-465d-9ca8-f213c006a935 service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-6d3e2cb8-c5e6-4970-8b91-221fbb8634dc req-e661d8e8-239f-465d-9ca8-f213c006a935 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] No waiting events found dispatching network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:49 user nova-compute[75258]: WARNING nova.compute.manager [req-6d3e2cb8-c5e6-4970-8b91-221fbb8634dc req-e661d8e8-239f-465d-9ca8-f213c006a935 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received unexpected event network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a for instance with vm_state building and task_state spawning.
Nov 14 12:37:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:37:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Instance spawned successfully.
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:37:51 user nova-compute[75258]: INFO nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Took 5.21 seconds to spawn the instance on the hypervisor.
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-fe5893fc-8d64-40a5-987e-32cce95acc45 req-9c6b8c5b-0a26-4e7a-aeeb-bbcefa43daf9 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fe5893fc-8d64-40a5-987e-32cce95acc45 req-9c6b8c5b-0a26-4e7a-aeeb-bbcefa43daf9 service nova] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fe5893fc-8d64-40a5-987e-32cce95acc45 req-9c6b8c5b-0a26-4e7a-aeeb-bbcefa43daf9 service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fe5893fc-8d64-40a5-987e-32cce95acc45 req-9c6b8c5b-0a26-4e7a-aeeb-bbcefa43daf9 service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-fe5893fc-8d64-40a5-987e-32cce95acc45 req-9c6b8c5b-0a26-4e7a-aeeb-bbcefa43daf9 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] No waiting events found dispatching network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:37:51 user nova-compute[75258]: WARNING nova.compute.manager [req-fe5893fc-8d64-40a5-987e-32cce95acc45 req-9c6b8c5b-0a26-4e7a-aeeb-bbcefa43daf9 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received unexpected event network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a for instance with vm_state building and task_state spawning.
Nov 14 12:37:51 user nova-compute[75258]: INFO nova.compute.manager [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Took 5.98 seconds to build instance.
Nov 14 12:37:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-65e9e97f-e3e7-4bb0-b0d8-404c9c2474f8 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.113s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:37:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:37:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG nova.compute.manager [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lazy-loading 'flavor' on Instance uuid 3fc117a2-be77-4cdb-b834-0e4a4d5da581 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:00 user nova-compute[75258]: INFO nova.compute.manager [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] instance snapshotting
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:00 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Beginning live snapshot process
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:00 user nova-compute[75258]: INFO nova.compute.manager [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Attaching volume e503b7a2-4579-4180-b6ca-5e7fbd00bcce to /dev/vdb
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG os_brick.utils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b29d34-187c-4bf2-afe8-6f698e6d995c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a2f0b41-51b9-46ae-9c0c-92114a0fd0fe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2306e2d8-ba23-4f45-8ad9-aafe25bc1ed2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a091a5d-b37e-4032-baa9-e39e63eb023e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-changed-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Refreshing instance network info cache due to event network-changed-088cce2a-366c-4b1e-a9cd-f9dba80599b0. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] Acquiring lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] Acquired lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Refreshing network info cache for port 088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:01 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[812830dd-8ad4-4770-929f-88da07470522]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG os_brick.utils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updating existing volume attachment record: 35fdb520-52e6-49d8-8bee-97a30f9b4a79 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json -f qcow2" returned: 0 in 0.197s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json -f qcow2" returned: 0 in 0.203s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb0_pm7zd/7826db9afe8f4f3ba87dcc8d7e368990.delta 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpb0_pm7zd/7826db9afe8f4f3ba87dcc8d7e368990.delta 1073741824" returned: 0 in 0.048s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 12:38:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Checking UEFI support for host arch (x86_64) {{(pid=75258) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Nov 14 12:38:01 user nova-compute[75258]: INFO nova.virt.libvirt.host [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] UEFI support detected
Nov 14 12:38:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Updated VIF entry in instance network info cache for port 088cce2a-366c-4b1e-a9cd-f9dba80599b0. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8f0ae7dd-c203-433b-92e9-68bb20a4be06 req-132a351e-536b-4e02-85f2-f189523526ec service nova] Releasing lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:38:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:38:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 12:38:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:02 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:38:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb0_pm7zd/7826db9afe8f4f3ba87dcc8d7e368990.delta /opt/stack/data/nova/instances/snapshots/tmpb0_pm7zd/7826db9afe8f4f3ba87dcc8d7e368990 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpb0_pm7zd/7826db9afe8f4f3ba87dcc8d7e368990.delta /opt/stack/data/nova/instances/snapshots/tmpb0_pm7zd/7826db9afe8f4f3ba87dcc8d7e368990" returned: 0 in 0.342s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Snapshot extracted, beginning image upload
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:03 user nova-compute[75258]: INFO nova.compute.manager [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Attaching volume 379c71d5-e136-4ba2-b189-a24752992f77 to /dev/vdb
Nov 14 12:38:03 user nova-compute[75258]: DEBUG os_brick.utils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94143d4-b27e-44d1-ad89-4c0a2deab79c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c3dee87-3d17-4a27-a9bb-5c50b1926f33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f838e9-b108-4617-b68f-c8dae11db59a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[157d4f5e-7f5e-4af9-b2d1-0f58abdf81fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:03 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:38:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3625b9b6-2f25-4eee-844d-2350aba71f4d]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG os_brick.utils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating existing volume attachment record: 8537eda6-defb-48fa-b3b2-fbe630e53f88 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:38:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDVBtGAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:05 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a41496-0428-41c0-aef4-bf0e01f1cfd7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:38:05 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3952f7e-5e9f-44c3-b263-9a501f90d8af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce] added
Nov 14 12:38:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[07cd5581-46d8-4370-935c-d53e3cf6a722]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0596d2-28f1-43cc-a3b3-e1ffbe807226]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDVBtGAf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LDVBtGAf" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cb1df2-be33-4a3b-aacf-2a6c265db991]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LDVBtGAf'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ee05317-6fbb-4eee-90a5-8a0134944620]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[071a9516-84d1-4acf-8c08-cadb699a946d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:05 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:05 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:05 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:05 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Snapshot image upload complete
Nov 14 12:38:05 user nova-compute[75258]: INFO nova.compute.manager [None req-396adb18-d741-481d-872f-eec8f9c85ef2 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Took 5.36 seconds to snapshot the instance on the hypervisor.
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[175c0374-edc4-4a3c-9432-0cd1a18bf80d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260]
Nov 14 12:38:05 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[769056c2-8183-48f4-980c-f88e4435532f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c4b6089-f601-4323-b091-841b5952db91]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:06 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:06 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:06 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:06 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:06 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:06 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.308s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[05891c78-f698-4151-8c4b-ead4b5e11e92]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDVBtGAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:38:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '26464383861653261', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464383861653261', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lazy-loading 'flavor' on Instance uuid 3fc117a2-be77-4cdb-b834-0e4a4d5da581 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:38:07 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:07 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:38:07 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:07 user nova-compute[75258]:   <serial>e503b7a2-4579-4180-b6ca-5e7fbd00bcce</serial>
Nov 14 12:38:07 user nova-compute[75258]: </disk>
Nov 14 12:38:07 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] No VIF found with MAC fa:16:3e:69:85:35, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-018f8092-aa0a-44ef-a752-ed19746352fe tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.971s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EonGjVlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:07 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3686ce-2741-432a-a90c-de6712f46427]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:38:07 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b770f6a6-3b3a-4587-b4d3-4aabd5ae8cec]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77] added
Nov 14 12:38:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2416d59b-e22a-42b8-836c-035f389febe3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db3a7016-0b6b-45ee-bf16-60fa253029ec]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EonGjVlQ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EonGjVlQ" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3af10de2-0943-4da1-91d7-197cbb3ab0e6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EonGjVlQ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb00aa08-a334-45b3-b4f0-bc7a328ae95a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfeabe4a-8f8d-44bd-93bb-e3f6963484e9]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f45b7f-ba23-4388-bb52-1ac086f0ba58]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]
Nov 14 12:38:08 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d6c5974-596c-4f71-811e-cbec94b6dfbd]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[28869490-f454-4d0d-bc32-e68a43b1ed50]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:08 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] HCTL ('37', '-', '-', 0) found on session 6 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27cc807a-904f-4c84-a931-7d26c675c8f8]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching for a device in session 6 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EonGjVlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:08 user nova-compute[75258]: INFO nova.compute.manager [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Terminating instance
Nov 14 12:38:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-32068abf-65c8-4546-8ca8-d4301458afd1 req-0d5fe001-0580-494c-9945-ad8ae62519b1 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received event network-vif-unplugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-32068abf-65c8-4546-8ca8-d4301458afd1 req-0d5fe001-0580-494c-9945-ad8ae62519b1 service nova] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-32068abf-65c8-4546-8ca8-d4301458afd1 req-0d5fe001-0580-494c-9945-ad8ae62519b1 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-32068abf-65c8-4546-8ca8-d4301458afd1 req-0d5fe001-0580-494c-9945-ad8ae62519b1 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-32068abf-65c8-4546-8ca8-d4301458afd1 req-0d5fe001-0580-494c-9945-ad8ae62519b1 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] No waiting events found dispatching network-vif-unplugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-32068abf-65c8-4546-8ca8-d4301458afd1 req-0d5fe001-0580-494c-9945-ad8ae62519b1 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received event network-vif-unplugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.371s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== connect_volume: return (1375ms) {'type': 'block', 'scsi_wwn': '23565336465303236', 'path': '/dev/sdf'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565336465303236', 'path': '/dev/sdf'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.objects.instance [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:09 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Instance destroyed successfully.
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lazy-loading 'resources' on Instance uuid 3fc117a2-be77-4cdb-b834-0e4a4d5da581 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-597089404',display_name='tempest-DeleteServersTestJSON-server-597089404',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-597089404',id=1,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d67a066c714c4d0fb2bab5ef1995ddb5',ramdisk_id='',reservation_id='r-m80pk2tw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1772678287',owner_user_name='tempest-DeleteServersTestJSON-1772678287-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:25Z,user_data=None,user_id='22f65262614340f69b5125a2b4281feb',uuid=3fc117a2-be77-4cdb-b834-0e4a4d5da581,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Converting VIF {"id": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "address": "fa:16:3e:69:85:35", "network": {"id": "c2153b4a-8d19-418f-8bc2-c4e8acec1c99", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-200080419-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d67a066c714c4d0fb2bab5ef1995ddb5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d2087ad-f1", "ovs_interfaceid": "8d2087ad-f1d3-40df-84bf-73b92e55f08d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:69:85:35,bridge_name='br-int',has_traffic_filtering=True,id=8d2087ad-f1d3-40df-84bf-73b92e55f08d,network=Network(c2153b4a-8d19-418f-8bc2-c4e8acec1c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d2087ad-f1') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_vif [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:85:35,bridge_name='br-int',has_traffic_filtering=True,id=8d2087ad-f1d3-40df-84bf-73b92e55f08d,network=Network(c2153b4a-8d19-418f-8bc2-c4e8acec1c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d2087ad-f1') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d2087ad-f1, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:38:09 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:09 user nova-compute[75258]:   <source dev="/dev/sdf"/>
Nov 14 12:38:09 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:09 user nova-compute[75258]:   <serial>379c71d5-e136-4ba2-b189-a24752992f77</serial>
Nov 14 12:38:09 user nova-compute[75258]: </disk>
Nov 14 12:38:09 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a41b2d94-bee1-4f7b-8bd2-fb170a94a086) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: INFO os_vif [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:69:85:35,bridge_name='br-int',has_traffic_filtering=True,id=8d2087ad-f1d3-40df-84bf-73b92e55f08d,network=Network(c2153b4a-8d19-418f-8bc2-c4e8acec1c99),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d2087ad-f1')
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LDVBtGAf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:09 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[75353640-635c-4b8d-be83-fe769efeb747]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:38:09 user nova-compute[75258]: No targets found.
Nov 14 12:38:09 user nova-compute[75258]: iSNS:
Nov 14 12:38:09 user nova-compute[75258]: No targets found.
Nov 14 12:38:09 user nova-compute[75258]: STATIC:
Nov 14 12:38:09 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce
Nov 14 12:38:09 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:09 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:09 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:38:09 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:09 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:09 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913
Nov 14 12:38:09 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:09 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:09 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed
Nov 14 12:38:09 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:09 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:09 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850
Nov 14 12:38:09 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:09 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:09 user nova-compute[75258]: FIRMWARE:
Nov 14 12:38:09 user nova-compute[75258]: No targets found.
Nov 14 12:38:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:38:09 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:38:09 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[81e5b1fa-13b2-4140-b56e-2a2c8d7f55f4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce570108-7483-4beb-a8c7-a4b77857e6e6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce (non-flash)
Nov 14 12:38:09 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b4082ef0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1674bb96-e270-435c-b65b-3103ddb5c5da]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5285799f-2973-4067-b258-ed04a3081530]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.011s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[199d8c1b-afb9-4ec2-ae05-bba0d63ea8a0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f7727-b25e-48b7-8c3c-4f65146047d2]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bb1226-1d31-486a-a254-5bfb25860f67]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b5d00b5-1f8b-4942-8208-d2656c0716c4]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260]
Nov 14 12:38:09 user nova-compute[75258]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e503b7a2-4579-4180-b6ca-5e7fbd00bcce -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[930853e0-8577-4cf4-9471-ed35e48e6381]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] <== disconnect_volume: return (334ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:38:09 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Deleting instance files /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581_del
Nov 14 12:38:09 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Deletion of /opt/stack/data/nova/instances/3fc117a2-be77-4cdb-b834-0e4a4d5da581_del complete
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: INFO nova.compute.manager [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Took 1.25 seconds to destroy the instance on the hypervisor.
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No VIF found with MAC fa:16:3e:5e:d1:fb, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd36c86a-fa5e-46ce-be21-20de6ffd9d80 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.660s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:10 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Took 0.82 seconds to deallocate network for instance.
Nov 14 12:38:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-71678e24-74ac-401c-ad67-67323263d866 req-5c8b806c-07a3-4739-99b3-964cb598fdc8 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received event network-vif-deleted-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:10 user nova-compute[75258]: INFO nova.compute.manager [req-71678e24-74ac-401c-ad67-67323263d866 req-5c8b806c-07a3-4739-99b3-964cb598fdc8 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Neutron deleted interface 8d2087ad-f1d3-40df-84bf-73b92e55f08d; detaching it from the instance and deleting it from the info cache
Nov 14 12:38:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-71678e24-74ac-401c-ad67-67323263d866 req-5c8b806c-07a3-4739-99b3-964cb598fdc8 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-71678e24-74ac-401c-ad67-67323263d866 req-5c8b806c-07a3-4739-99b3-964cb598fdc8 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Detach interface failed, port_id=8d2087ad-f1d3-40df-84bf-73b92e55f08d, reason: Instance 3fc117a2-be77-4cdb-b834-0e4a4d5da581 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-91b16638-dacd-44d8-9000-3d1b8837cd16 req-aa2d916a-1d5d-4f03-8a95-79456e83ad75 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received event network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91b16638-dacd-44d8-9000-3d1b8837cd16 req-aa2d916a-1d5d-4f03-8a95-79456e83ad75 service nova] Acquiring lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91b16638-dacd-44d8-9000-3d1b8837cd16 req-aa2d916a-1d5d-4f03-8a95-79456e83ad75 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91b16638-dacd-44d8-9000-3d1b8837cd16 req-aa2d916a-1d5d-4f03-8a95-79456e83ad75 service nova] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-91b16638-dacd-44d8-9000-3d1b8837cd16 req-aa2d916a-1d5d-4f03-8a95-79456e83ad75 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] No waiting events found dispatching network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:10 user nova-compute[75258]: WARNING nova.compute.manager [req-91b16638-dacd-44d8-9000-3d1b8837cd16 req-aa2d916a-1d5d-4f03-8a95-79456e83ad75 service nova] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Received unexpected event network-vif-plugged-8d2087ad-f1d3-40df-84bf-73b92e55f08d for instance with vm_state active and task_state deleting.
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7ad3eef0-50c1-43c9-bb55-b57e3f87ed9c tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7ad3eef0-50c1-43c9-bb55-b57e3f87ed9c tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7ad3eef0-50c1-43c9-bb55-b57e3f87ed9c tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7ad3eef0-50c1-43c9-bb55-b57e3f87ed9c tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75258) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-7ad3eef0-50c1-43c9-bb55-b57e3f87ed9c tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:11 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Error from libvirt while getting description of instance-00000001: [Error Code 42] Domain not found: no domain with matching uuid '3fc117a2-be77-4cdb-b834-0e4a4d5da581' (instance-00000001): libvirt.libvirtError: Domain not found: no domain with matching uuid '3fc117a2-be77-4cdb-b834-0e4a4d5da581' (instance-00000001)
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-01acef1c-082f-4b36-a583-92f7d9c09b10 req-60eaa89c-fe5f-44bd-bc4f-3a77e58ae28c service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-01acef1c-082f-4b36-a583-92f7d9c09b10 req-60eaa89c-fe5f-44bd-bc4f-3a77e58ae28c service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-01acef1c-082f-4b36-a583-92f7d9c09b10 req-60eaa89c-fe5f-44bd-bc4f-3a77e58ae28c service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-01acef1c-082f-4b36-a583-92f7d9c09b10 req-60eaa89c-fe5f-44bd-bc4f-3a77e58ae28c service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-01acef1c-082f-4b36-a583-92f7d9c09b10 req-60eaa89c-fe5f-44bd-bc4f-3a77e58ae28c service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:11 user nova-compute[75258]: WARNING nova.compute.manager [req-01acef1c-082f-4b36-a583-92f7d9c09b10 req-60eaa89c-fe5f-44bd-bc4f-3a77e58ae28c service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state active and task_state powering-off.
Nov 14 12:38:11 user nova-compute[75258]: INFO nova.compute.manager [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] [instance: 3fc117a2-be77-4cdb-b834-0e4a4d5da581] Took 0.86 seconds to detach 1 volumes for instance.
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:38:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=6639MB free_disk=25.32825469970703GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance destroyed successfully.
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7ad3eef0-50c1-43c9-bb55-b57e3f87ed9c tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7ad3eef0-50c1-43c9-bb55-b57e3f87ed9c tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.270s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.851s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.212s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:12 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Deleted allocations for instance 3fc117a2-be77-4cdb-b834-0e4a4d5da581
Nov 14 12:38:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f0ed8e7b-0ff1-459a-90ea-370d78c72e58 tempest-DeleteServersTestJSON-1772678287 tempest-DeleteServersTestJSON-1772678287-project-member] Lock "3fc117a2-be77-4cdb-b834-0e4a4d5da581" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.016s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3121053b-59aa-4412-aee7-a4b54d99d50d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 489542b7-b3a3-4004-a9c0-69d90a626497 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance f8188411-19c7-4ca9-adb1-3dbf7a994566 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance fda05899-30ea-43b3-9191-f0a4a5bbba4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance b62c235b-e019-47c3-9a0a-73dddd9df33a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3c2491e0-6711-4e46-9290-a4e4ad834cab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4cd80282-24f6-4b44-bb13-f9586d478364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:38:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.547s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-978d403f-ab55-409b-96b4-f610f1605bd5 req-1064627a-be29-4c02-a8b4-aa41456d889e service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-978d403f-ab55-409b-96b4-f610f1605bd5 req-1064627a-be29-4c02-a8b4-aa41456d889e service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-978d403f-ab55-409b-96b4-f610f1605bd5 req-1064627a-be29-4c02-a8b4-aa41456d889e service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-978d403f-ab55-409b-96b4-f610f1605bd5 req-1064627a-be29-4c02-a8b4-aa41456d889e service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-978d403f-ab55-409b-96b4-f610f1605bd5 req-1064627a-be29-4c02-a8b4-aa41456d889e service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:13 user nova-compute[75258]: WARNING nova.compute.manager [req-978d403f-ab55-409b-96b4-f610f1605bd5 req-1064627a-be29-4c02-a8b4-aa41456d889e service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state stopped and task_state None.
Nov 14 12:38:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:38:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-changed-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Refreshing instance network info cache due to event network-changed-f2a19abe-f21b-4f2e-9f66-ecaa8194805f. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] Acquiring lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] Acquired lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:15 user nova-compute[75258]: DEBUG nova.network.neutron [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Refreshing network info cache for port f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updated VIF entry in instance network info cache for port f2a19abe-f21b-4f2e-9f66-ecaa8194805f. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updating instance_info_cache with network_info: [{"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-78f1fa61-a6b9-4b2a-b481-f0763825180f req-a89da7d8-51a7-4cd1-8502-20cd44733b35 service nova] Releasing lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:17 user nova-compute[75258]: DEBUG nova.objects.instance [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lazy-loading 'flavor' on Instance uuid 3121053b-59aa-4412-aee7-a4b54d99d50d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:18 user nova-compute[75258]: INFO nova.compute.manager [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Attaching volume b2a67466-09ce-4a6f-a6d2-65334fa08eb3 to /dev/vdb
Nov 14 12:38:18 user nova-compute[75258]: DEBUG os_brick.utils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a21d17-6fa9-4c12-995d-1eddfd9cdaf7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6630bc04-9de4-4b40-aee4-1b37722c1d52]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a65697f6-a946-4762-99c9-cd786361878a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2c0a823-4936-455b-9213-ab2523c934cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:18 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26156507-36ee-4e7f-9d6a-de415facc6e3]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG os_brick.utils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updating existing volume attachment record: 7d193eb4-a403-465a-89a8-1073069eeefe {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "489542b7-b3a3-4004-a9c0-69d90a626497" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "489542b7-b3a3-4004-a9c0-69d90a626497" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:18 user nova-compute[75258]: INFO nova.compute.manager [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Terminating instance
Nov 14 12:38:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f16701c4-fefd-4d73-910b-4bb170797e64 req-b84a1626-0af4-4b22-9d82-3c1d1b3ded0c service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received event network-vif-unplugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f16701c4-fefd-4d73-910b-4bb170797e64 req-b84a1626-0af4-4b22-9d82-3c1d1b3ded0c service nova] Acquiring lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f16701c4-fefd-4d73-910b-4bb170797e64 req-b84a1626-0af4-4b22-9d82-3c1d1b3ded0c service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f16701c4-fefd-4d73-910b-4bb170797e64 req-b84a1626-0af4-4b22-9d82-3c1d1b3ded0c service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f16701c4-fefd-4d73-910b-4bb170797e64 req-b84a1626-0af4-4b22-9d82-3c1d1b3ded0c service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] No waiting events found dispatching network-vif-unplugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f16701c4-fefd-4d73-910b-4bb170797e64 req-b84a1626-0af4-4b22-9d82-3c1d1b3ded0c service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received event network-vif-unplugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Instance destroyed successfully.
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.objects.instance [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lazy-loading 'resources' on Instance uuid 489542b7-b3a3-4004-a9c0-69d90a626497 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1594018747',display_name='tempest-VolumesActionsTest-instance-1594018747',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1594018747',id=5,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='881b748cca5c4f31b10b931164e5e1aa',ramdisk_id='',reservation_id='r-fraha80i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1666751966',owner_user_name='tempest-VolumesActionsTest-1666751966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:40Z,user_data=None,user_id='6a1cc10ee97a471680b98fcf53c94173',uuid=489542b7-b3a3-4004-a9c0-69d90a626497,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converting VIF {"id": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "address": "fa:16:3e:9e:ef:ab", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape34f2ece-ca", "ovs_interfaceid": "e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:ab,bridge_name='br-int',has_traffic_filtering=True,id=e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f2ece-ca') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG os_vif [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:ab,bridge_name='br-int',has_traffic_filtering=True,id=e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f2ece-ca') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape34f2ece-ca, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=fa349cda-404b-4ad4-bbcc-c13d686b61a6) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:19 user nova-compute[75258]: INFO os_vif [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9e:ef:ab,bridge_name='br-int',has_traffic_filtering=True,id=e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape34f2ece-ca')
Nov 14 12:38:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Deleting instance files /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497_del
Nov 14 12:38:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Deletion of /opt/stack/data/nova/instances/489542b7-b3a3-4004-a9c0-69d90a626497_del complete
Nov 14 12:38:19 user nova-compute[75258]: INFO nova.compute.manager [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 12:38:19 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:19 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Took 0.42 seconds to deallocate network for instance.
Nov 14 12:38:19 user nova-compute[75258]: DEBUG nova.compute.manager [req-73d232cf-6449-4627-a430-c34b123db83f req-c47e8b7c-2eab-4b41-9714-3e19c11041e9 service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received event network-vif-deleted-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:20 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Deleted allocations for instance 489542b7-b3a3-4004-a9c0-69d90a626497
Nov 14 12:38:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97900259-c705-45ed-9241-6467f836c65a tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "489542b7-b3a3-4004-a9c0-69d90a626497" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.845s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-b24efdbb-4ba4-46e3-bfcb-c960a8a146a4 req-005bf549-3625-46b9-bf1b-1c3d5524126a service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received event network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b24efdbb-4ba4-46e3-bfcb-c960a8a146a4 req-005bf549-3625-46b9-bf1b-1c3d5524126a service nova] Acquiring lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b24efdbb-4ba4-46e3-bfcb-c960a8a146a4 req-005bf549-3625-46b9-bf1b-1c3d5524126a service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b24efdbb-4ba4-46e3-bfcb-c960a8a146a4 req-005bf549-3625-46b9-bf1b-1c3d5524126a service nova] Lock "489542b7-b3a3-4004-a9c0-69d90a626497-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-b24efdbb-4ba4-46e3-bfcb-c960a8a146a4 req-005bf549-3625-46b9-bf1b-1c3d5524126a service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] No waiting events found dispatching network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:20 user nova-compute[75258]: WARNING nova.compute.manager [req-b24efdbb-4ba4-46e3-bfcb-c960a8a146a4 req-005bf549-3625-46b9-bf1b-1c3d5524126a service nova] [instance: 489542b7-b3a3-4004-a9c0-69d90a626497] Received unexpected event network-vif-plugged-e34f2ece-ca43-4dd8-9cd4-cdfaa56a67cd for instance with vm_state deleted and task_state None.
Nov 14 12:38:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voBfbpjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:22 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:22 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:22 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c474797c-f15c-4d34-800b-7e32c86590c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:38:22 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f070ea-c6ef-4707-9125-ce5ac01036cb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3] added
Nov 14 12:38:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[16219afc-a94b-4f60-bb71-0ab397ce1e8c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7d13b4-2df9-4436-b8b5-fb18e642f30f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voBfbpjX {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v voBfbpjX" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[717bcebc-dde5-4d52-b40c-fd023de03a77]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'voBfbpjX'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9539ccf1-9d2f-4777-881a-194efee648bf]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[793f95ea-e212-4c3e-8975-d0ba626e7a6f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:22 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:22 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:22 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:22 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:22 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:22 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4ed8aa-7cdf-4243-b87b-318833ea5266]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260]
Nov 14 12:38:23 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9491e2a3-4da6-4d45-bf52-bf91dcf88d6f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48ba00b7-283a-41c8-836f-acdc9ba731fd]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.294s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] HCTL ('36', '-', '-', 0) found on session 7 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79a6223-81cb-43b8-a91d-6d1c2b6a306b]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Searching for a device in session 7 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voBfbpjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:38:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.335s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] <== connect_volume: return (1337ms) {'type': 'block', 'scsi_wwn': '23139323065336439', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23139323065336439', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lazy-loading 'flavor' on Instance uuid 3121053b-59aa-4412-aee7-a4b54d99d50d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:38:24 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:24 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:38:24 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:24 user nova-compute[75258]:   <serial>b2a67466-09ce-4a6f-a6d2-65334fa08eb3</serial>
Nov 14 12:38:24 user nova-compute[75258]: </disk>
Nov 14 12:38:24 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] No VIF found with MAC fa:16:3e:f3:7a:fb, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:38:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-03296722-e341-4b15-a003-e79dbf16e1da tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.587s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:26 user nova-compute[75258]: INFO nova.compute.manager [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Detaching volume b2a67466-09ce-4a6f-a6d2-65334fa08eb3
Nov 14 12:38:26 user nova-compute[75258]: INFO nova.virt.block_device [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Attempting to driver detach volume b2a67466-09ce-4a6f-a6d2-65334fa08eb3 from mountpoint /dev/vdb
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Attempting to detach device vdb from instance 3121053b-59aa-4412-aee7-a4b54d99d50d from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:26 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:26 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:38:26 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:26 user nova-compute[75258]:   <serial>b2a67466-09ce-4a6f-a6d2-65334fa08eb3</serial>
Nov 14 12:38:26 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:38:26 user nova-compute[75258]: </disk>
Nov 14 12:38:26 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Successfully detached device vdb from instance 3121053b-59aa-4412-aee7-a4b54d99d50d from the persistent domain config.
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3121053b-59aa-4412-aee7-a4b54d99d50d from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:26 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:26 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:38:26 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:26 user nova-compute[75258]:   <serial>b2a67466-09ce-4a6f-a6d2-65334fa08eb3</serial>
Nov 14 12:38:26 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:38:26 user nova-compute[75258]: </disk>
Nov 14 12:38:26 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-changed-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Refreshing instance network info cache due to event network-changed-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] Acquiring lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] Acquired lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.network.neutron [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Refreshing network info cache for port 80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3121053b-59aa-4412-aee7-a4b54d99d50d {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.network.neutron [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updated VIF entry in instance network info cache for port 80453c54-c7d6-4bf7-8cbd-f9956a9c52d5. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG nova.network.neutron [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updating instance_info_cache with network_info: [{"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f822ef2-d3f6-4627-a171-0f7f4d8bb98a req-d3256c97-874b-4f39-9b68-c066bfb880a4 service nova] Releasing lock "refresh_cache-f8188411-19c7-4ca9-adb1-3dbf7a994566" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lazy-loading 'flavor' on Instance uuid f8188411-19c7-4ca9-adb1-3dbf7a994566 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:28 user nova-compute[75258]: INFO nova.compute.manager [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Attaching volume 0d86c291-45ae-4e52-a965-b53b1d168884 to /dev/sdc
Nov 14 12:38:28 user nova-compute[75258]: DEBUG os_brick.utils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[93581d4c-da1c-435a-b97d-42fd6a76f93e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de750a11-0e9f-4e0a-ac21-22083145066a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e501d3ca-cebf-4210-a655-afbed3b2f474]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d352750a-a4cb-4994-bb3d-e5cc4f475268]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:28 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e495536b-d0f7-4a5c-892b-3e18537be10a]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG os_brick.utils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updating existing volume attachment record: c2e28d1d-2626-4f5f-ab4d-27c29b9093fb {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-changed-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Refreshing instance network info cache due to event network-changed-84f9ac77-622e-413e-9490-b2be292eee05. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] Acquiring lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] Acquired lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.network.neutron [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Refreshing network info cache for port 84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "interface-fda05899-30ea-43b3-9191-f0a4a5bbba4d-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "interface-fda05899-30ea-43b3-9191-f0a4a5bbba4d-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'flavor' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.network.neutron [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updated VIF entry in instance network info cache for port 84f9ac77-622e-413e-9490-b2be292eee05. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:28 user nova-compute[75258]: DEBUG nova.network.neutron [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-05c88e15-4939-45fe-bb92-152952c6b47d req-6d19900a-ca04-4fa1-91c5-3fce0b94a243 service nova] Releasing lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:29 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'pci_requests' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:29 user nova-compute[75258]: DEBUG nova.objects.base [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Object Instance<fda05899-30ea-43b3-9191-f0a4a5bbba4d> lazy-loaded attributes: flavor,pci_requests {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:38:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:38:29 user nova-compute[75258]: DEBUG nova.policy [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd09eb01d5c6741b4ac32283284df01ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4b829e058e44d7cb8eeb158f2b6ea72', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:38:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Successfully created port: 25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Successfully updated port: 25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquired lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-changed-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Refreshing instance network info cache due to event network-changed-25ecabbe-697f-4a21-b558-f3d67d0bcf47. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] Acquiring lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Releasing lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] Acquired lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Refreshing network info cache for port 25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converting VIF {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG os_vif [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1143cedd-f260-508f-bc39-948562fd07e0', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25ecabbe-69, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25ecabbe-69, col_values=(('qos', UUID('0ce15b34-571e-462d-8c72-5b6a740137eb')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25ecabbe-69, col_values=(('external_ids', {'iface-id': '25ecabbe-697f-4a21-b558-f3d67d0bcf47', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:26:a2:69', 'vm-uuid': 'fda05899-30ea-43b3-9191-f0a4a5bbba4d'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: INFO os_vif [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69')
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converting VIF {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] attach device xml: <interface type="ethernet">
Nov 14 12:38:30 user nova-compute[75258]:   <mac address="fa:16:3e:26:a2:69"/>
Nov 14 12:38:30 user nova-compute[75258]:   <model type="virtio"/>
Nov 14 12:38:30 user nova-compute[75258]:   <mtu size="1442"/>
Nov 14 12:38:30 user nova-compute[75258]:   <target dev="tap25ecabbe-69"/>
Nov 14 12:38:30 user nova-compute[75258]: </interface>
Nov 14 12:38:30 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-22ff5bf8-525a-4412-84d2-919eda27429b req-3db33c77-283f-4bac-9453-8832c7824949 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-22ff5bf8-525a-4412-84d2-919eda27429b req-3db33c77-283f-4bac-9453-8832c7824949 service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-22ff5bf8-525a-4412-84d2-919eda27429b req-3db33c77-283f-4bac-9453-8832c7824949 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-22ff5bf8-525a-4412-84d2-919eda27429b req-3db33c77-283f-4bac-9453-8832c7824949 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-22ff5bf8-525a-4412-84d2-919eda27429b req-3db33c77-283f-4bac-9453-8832c7824949 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:31 user nova-compute[75258]: WARNING nova.compute.manager [req-22ff5bf8-525a-4412-84d2-919eda27429b req-3db33c77-283f-4bac-9453-8832c7824949 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received unexpected event network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 for instance with vm_state active and task_state None.
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.network.neutron [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updated VIF entry in instance network info cache for port 25ecabbe-697f-4a21-b558-f3d67d0bcf47. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.network.neutron [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75da57f8-dc20-4095-b6ae-cb4f307fcd90 req-e2d6ac03-58d4-4205-bc42-c06c35aa369a service nova] Releasing lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No BDM found with device name hda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No VIF found with MAC fa:16:3e:de:48:6b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:38:31 user nova-compute[75258]:   <nova:package version="0.0.0"/>
Nov 14 12:38:31 user nova-compute[75258]:   <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:38:31 user nova-compute[75258]:   <nova:creationTime>2023-11-14 12:38:31</nova:creationTime>
Nov 14 12:38:31 user nova-compute[75258]:   <nova:flavor name="m1.tiny">
Nov 14 12:38:31 user nova-compute[75258]:     <nova:memory>512</nova:memory>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:disk>1</nova:disk>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:swap>0</nova:swap>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:vcpus>1</nova:vcpus>
Nov 14 12:38:31 user nova-compute[75258]:   </nova:flavor>
Nov 14 12:38:31 user nova-compute[75258]:   <nova:owner>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:38:31 user nova-compute[75258]:   </nova:owner>
Nov 14 12:38:31 user nova-compute[75258]:   <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:38:31 user nova-compute[75258]:   <nova:ports>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:38:31 user nova-compute[75258]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:38:31 user nova-compute[75258]:     </nova:port>
Nov 14 12:38:31 user nova-compute[75258]:     <nova:port uuid="25ecabbe-697f-4a21-b558-f3d67d0bcf47">
Nov 14 12:38:31 user nova-compute[75258]:       <nova:ip type="fixed" address="10.10.10.197" ipVersion="4"/>
Nov 14 12:38:31 user nova-compute[75258]:     </nova:port>
Nov 14 12:38:31 user nova-compute[75258]:   </nova:ports>
Nov 14 12:38:31 user nova-compute[75258]: </nova:instance>
Nov 14 12:38:31 user nova-compute[75258]:  {{(pid=75258) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6bdc2709-1be5-4058-97d4-dc9c302e3924 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "interface-fda05899-30ea-43b3-9191-f0a4a5bbba4d-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 2.447s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG nova.objects.instance [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'flavor' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:32 user nova-compute[75258]: INFO nova.compute.manager [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Attaching volume 7da99084-1473-4316-97cc-626411cc4261 to /dev/vdb
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.utils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d09a766-947e-4e86-b20c-04662cbdcb3a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a201bca-7edb-48d6-9736-2e158c2a3ea9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a2388fe-16f0-44ff-85ec-cf9e1142d1bd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa11be6-cad1-4fe7-b4ac-86b4dedcd865]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:32 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6bc94f6-9095-4022-aef3-2e8c64a4b76d]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.utils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating existing volume attachment record: d3641dd3-349a-469b-b6a8-4344c9f99767 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVsUDNHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:32 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:32 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:32 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb524ec-73eb-41f6-8afa-97a8916d9856]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:38:32 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb0c267-0978-43e2-b334-cdd7990bb34d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884] added
Nov 14 12:38:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba79352-de9c-48eb-b839-10425477170b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[84534d72-cb9f-45ec-94a9-04007e21f18f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVsUDNHE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yVsUDNHE" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd442664-15a8-4231-ba1d-929847a03e56]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yVsUDNHE'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30f2a21-0110-4ec6-96ab-599399ea3c8e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d27f47e8-3cb7-4fd9-b4c9-5dc86da6418f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[28cb9e1c-0ee7-445c-9806-c3e9e8f44610]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260]
Nov 14 12:38:33 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61fed9e-71fd-4fca-b655-5bb4724d4782]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7104e29b-8e08-4475-8585-2bfae7032f0e]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] HCTL ('38', '-', '-', 0) found on session 8 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8939501c-ae41-4015-9a25-74f944a1a378]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Searching for a device in session 8 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVsUDNHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-464c9ba6-8da0-4005-91d4-b823d3705610 req-97731677-44c3-4e1d-b589-0cc0eb166889 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-464c9ba6-8da0-4005-91d4-b823d3705610 req-97731677-44c3-4e1d-b589-0cc0eb166889 service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-464c9ba6-8da0-4005-91d4-b823d3705610 req-97731677-44c3-4e1d-b589-0cc0eb166889 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-464c9ba6-8da0-4005-91d4-b823d3705610 req-97731677-44c3-4e1d-b589-0cc0eb166889 service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-464c9ba6-8da0-4005-91d4-b823d3705610 req-97731677-44c3-4e1d-b589-0cc0eb166889 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:33 user nova-compute[75258]: WARNING nova.compute.manager [req-464c9ba6-8da0-4005-91d4-b823d3705610 req-97731677-44c3-4e1d-b589-0cc0eb166889 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received unexpected event network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 for instance with vm_state active and task_state None.
Nov 14 12:38:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] <== connect_volume: return (1323ms) {'type': 'block', 'scsi_wwn': '23839626232613437', 'path': '/dev/sdg'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23839626232613437', 'path': '/dev/sdg'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lazy-loading 'flavor' on Instance uuid f8188411-19c7-4ca9-adb1-3dbf7a994566 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:38:34 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:34 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:38:34 user nova-compute[75258]:   <target dev="sdc" bus="scsi"/>
Nov 14 12:38:34 user nova-compute[75258]:   <serial>0d86c291-45ae-4e52-a965-b53b1d168884</serial>
Nov 14 12:38:34 user nova-compute[75258]:   <address type="drive" controller="0" unit="2"/>
Nov 14 12:38:34 user nova-compute[75258]: </disk>
Nov 14 12:38:34 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] No BDM found with device name sda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] No BDM found with device name sdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] No BDM found with device name sdc, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] No VIF found with MAC fa:16:3e:d1:03:aa, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:38:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3e390196-19ad-4d0d-a1bb-0dccacb6d319 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.517s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:36 user nova-compute[75258]: INFO nova.compute.manager [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Detaching volume 0d86c291-45ae-4e52-a965-b53b1d168884
Nov 14 12:38:36 user nova-compute[75258]: INFO nova.virt.block_device [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Attempting to driver detach volume 0d86c291-45ae-4e52-a965-b53b1d168884 from mountpoint /dev/sdc
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Attempting to detach device sdc from instance f8188411-19c7-4ca9-adb1-3dbf7a994566 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:36 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:36 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:38:36 user nova-compute[75258]:   <target dev="sdc" bus="scsi"/>
Nov 14 12:38:36 user nova-compute[75258]:   <serial>0d86c291-45ae-4e52-a965-b53b1d168884</serial>
Nov 14 12:38:36 user nova-compute[75258]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 12:38:36 user nova-compute[75258]: </disk>
Nov 14 12:38:36 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Successfully detached device sdc from instance f8188411-19c7-4ca9-adb1-3dbf7a994566 from the persistent domain config.
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance f8188411-19c7-4ca9-adb1-3dbf7a994566 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:36 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:36 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:38:36 user nova-compute[75258]:   <target dev="sdc" bus="scsi"/>
Nov 14 12:38:36 user nova-compute[75258]:   <serial>0d86c291-45ae-4e52-a965-b53b1d168884</serial>
Nov 14 12:38:36 user nova-compute[75258]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Nov 14 12:38:36 user nova-compute[75258]: </disk>
Nov 14 12:38:36 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-changed-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Refreshing instance network info cache due to event network-changed-f08eb35e-122b-42c2-9b2a-b8a2acdc37da. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] Acquiring lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] Acquired lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Refreshing network info cache for port f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance f8188411-19c7-4ca9-adb1-3dbf7a994566 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lazy-loading 'flavor' on Instance uuid 1ec48019-6248-4bcf-8c4d-bb07d135ce3f {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.073s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybxsIvtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:36 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:36 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:36 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea737541-61c0-4a55-9a1b-ebfef895b502]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:38:36 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[987e05fa-b81c-42e0-af23-acca97640752]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261] added
Nov 14 12:38:36 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d212f5-cdc3-493a-bc53-1775fc41a49d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef7d59d-9c00-412c-890c-e131ee5ea7a9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybxsIvtq {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Updated VIF entry in instance network info cache for port f08eb35e-122b-42c2-9b2a-b8a2acdc37da. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Updating instance_info_cache with network_info: [{"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ybxsIvtq" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bae798c-387a-4839-b50e-73e6c750ac39]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ybxsIvtq'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:36 user nova-compute[75258]: INFO nova.compute.manager [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Attaching volume f01e8bed-844a-4928-8d6a-bee0dfc1684c to /dev/vdb
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-167948d3-a0c3-4848-a08e-6dfa117b09db req-3a61b22f-6000-44c0-9dd0-973a2f93e66d service nova] Releasing lock "refresh_cache-1ec48019-6248-4bcf-8c4d-bb07d135ce3f" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6221ddf8-79f8-4954-93dc-e05a364e1704]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[641cfc19-fc91-4eaa-b309-db4c9224869b]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.utils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2e6da9b-7099-4706-89b3-8fa8edaaaf38]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[53d1b0ca-248b-4620-a569-12c86cbf35d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260]
Nov 14 12:38:37 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9711b0cb-7d2b-475d-b9c0-0234a1950a76]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4446dc0c-1d83-4614-880c-02400b61bc2c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b297a47-0c07-449b-ae10-010a95c88188]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3f73a6-1673-4a57-8f1f-4cc087f9e85d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] HCTL ('39', '-', '-', 0) found on session 9 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a6195d-518d-41aa-955b-4911a889d3f3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[03c265c5-428e-4f39-a294-55348ebd7324]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Searching for a device in session 9 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybxsIvtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:37 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:38:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ce0ca6-3e1c-4309-89f3-eb050f5eb6ea]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG os_brick.utils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] <== get_connector_properties: return (148ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:37 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Updating existing volume attachment record: 03b1bc01-4b2d-42ef-af5a-feee010a7d6e {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.387s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] <== connect_volume: return (1389ms) {'type': 'block', 'scsi_wwn': '23436363131396533', 'path': '/dev/sdh'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436363131396533', 'path': '/dev/sdh'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'flavor' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:38:38 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:38 user nova-compute[75258]:   <source dev="/dev/sdh"/>
Nov 14 12:38:38 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:38 user nova-compute[75258]:   <serial>7da99084-1473-4316-97cc-626411cc4261</serial>
Nov 14 12:38:38 user nova-compute[75258]: </disk>
Nov 14 12:38:38 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No BDM found with device name hda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] No VIF found with MAC fa:16:3e:de:48:6b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-72f469a7-ee6d-4c4c-ae22-537cdb99186a tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.765s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:40 user nova-compute[75258]: INFO nova.compute.manager [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Detaching volume 7da99084-1473-4316-97cc-626411cc4261
Nov 14 12:38:40 user nova-compute[75258]: INFO nova.virt.block_device [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Attempting to driver detach volume 7da99084-1473-4316-97cc-626411cc4261 from mountpoint /dev/vdb
Nov 14 12:38:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Attempting to detach device vdb from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:38:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:40 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:40 user nova-compute[75258]:   <source dev="/dev/sdh"/>
Nov 14 12:38:40 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:40 user nova-compute[75258]:   <serial>7da99084-1473-4316-97cc-626411cc4261</serial>
Nov 14 12:38:40 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 12:38:40 user nova-compute[75258]: </disk>
Nov 14 12:38:40 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully detached device vdb from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the persistent domain config.
Nov 14 12:38:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:38:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:40 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:40 user nova-compute[75258]:   <source dev="/dev/sdh"/>
Nov 14 12:38:40 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:40 user nova-compute[75258]:   <serial>7da99084-1473-4316-97cc-626411cc4261</serial>
Nov 14 12:38:40 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 12:38:40 user nova-compute[75258]: </disk>
Nov 14 12:38:40 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:38:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWlIeSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:41 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c8520e4-473c-4715-9e47-4ddfb9625a25]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:38:41 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e336f11-6351-4e05-b049-046014305967]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c] added
Nov 14 12:38:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[357b089c-61b9-4cf1-8d6c-59cabf31a260]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d4f343-32de-4e71-96e7-95d38145cdc5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsWlIeSn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DsWlIeSn" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[252900e8-d319-4e4c-bea3-66df13a10e21]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DsWlIeSn'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[371f4ba2-863d-470a-ac80-1b3a0ca2e466]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[09053373-b469-443f-afcd-6b93456c15d8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6d53f5c-ddf9-4889-a748-eeb534cee126]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260]
Nov 14 12:38:41 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc66170d-7825-408c-859b-857a3ac8f1d1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f25e3023-07ea-48fc-8fcd-f79b094ecbab]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] HCTL ('40', '-', '-', 0) found on session 10 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Scanning host 40 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b3ca5f4-428d-4625-8007-e84e108e42ab]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Searching for a device in session 10 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:38:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWlIeSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:38:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.342s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] <== connect_volume: return (1344ms) {'type': 'block', 'scsi_wwn': '23938663935313738', 'path': '/dev/sdi'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23938663935313738', 'path': '/dev/sdi'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:38:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lazy-loading 'flavor' on Instance uuid 1ec48019-6248-4bcf-8c4d-bb07d135ce3f {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] attach device xml: <disk type="block" device="disk">
Nov 14 12:38:42 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:42 user nova-compute[75258]:   <source dev="/dev/sdi"/>
Nov 14 12:38:42 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:42 user nova-compute[75258]:   <serial>f01e8bed-844a-4928-8d6a-bee0dfc1684c</serial>
Nov 14 12:38:42 user nova-compute[75258]: </disk>
Nov 14 12:38:42 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:38:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:38:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] No VIF found with MAC fa:16:3e:75:b6:6b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:38:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af92507c-c2f7-4fe3-ba0b-82894b861a57 tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.535s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] volume_snapshot_create: create_info: {'snapshot_id': 'e56a1082-105b-4ba1-9fd2-fef8a1447156', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=75258) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3576}}
Nov 14 12:38:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] snap xml: <domainsnapshot>
Nov 14 12:38:44 user nova-compute[75258]:   <disks>
Nov 14 12:38:44 user nova-compute[75258]:     <disk name="/dev/sdi" snapshot="external" type="file">
Nov 14 12:38:44 user nova-compute[75258]:       <source file="/dev/new_file"/>
Nov 14 12:38:44 user nova-compute[75258]:     </disk>
Nov 14 12:38:44 user nova-compute[75258]:     <disk name="vda" snapshot="no"/>
Nov 14 12:38:44 user nova-compute[75258]:   </disks>
Nov 14 12:38:44 user nova-compute[75258]: </domainsnapshot>
Nov 14 12:38:44 user nova-compute[75258]:  {{(pid=75258) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3517}}
Nov 14 12:38:44 user nova-compute[75258]: DEBUG nova.objects.instance [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] Lazy-loading 'system_metadata' on Instance uuid 1ec48019-6248-4bcf-8c4d-bb07d135ce3f {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:44 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     rv = execute(f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     six.reraise(c, e, tb)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     raise value
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     rv = meth(*args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     self._volume_snapshot_create(context, instance, guest,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     rv = execute(f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     six.reraise(c, e, tb)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     raise value
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     rv = meth(*args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] 
Nov 14 12:38:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c97a576c-8f19-4a99-81d7-06ff74deb52a tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] volume_snapshot_delete: delete_info: {'volume_id': 'f01e8bed-844a-4928-8d6a-bee0dfc1684c'} {{(pid=75258) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3677}}
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [None req-c97a576c-8f19-4a99-81d7-06ff74deb52a tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type'
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f]     if delete_info['type'] != 'qcow2':
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] KeyError: 'type'
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot e56a1082-105b-4ba1-9fd2-fef8a1447156 could not be found.
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_create(context, instance, guest,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     rv = execute(f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     six.reraise(c, e, tb)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise value
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     rv = meth(*args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot e56a1082-105b-4ba1-9fd2-fef8a1447156 could not be found. (HTTP 404) (Request-ID: req-98fe4690-0a1a-4f73-b34e-ba19169a414e)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot e56a1082-105b-4ba1-9fd2-fef8a1447156 could not be found.
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver [None req-c97a576c-8f19-4a99-81d7-06ff74deb52a tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     if delete_info['type'] != 'qcow2':
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver KeyError: 'type'
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-3a86c084-b3f8-4d59-9062-d902385a3a3e)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred:
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3416, in _volume_snapshot_update_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     self._volume_api.update_snapshot_status(context,
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 397, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 468, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id))
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 488, in _reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise desired_exc.with_traceback(sys.exc_info()[2])
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     res = method(self, ctx, snapshot_id, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/nova/nova/volume/cinder.py", line 761, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     vs.update_snapshot_status(
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._action('os-update_snapshot_status',
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     resp, body = self.api.client.post(url, body=body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 223, in post
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self._cs_request(url, 'POST', **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 211, in _cs_request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     return self.request(url, method, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver   File "/opt/stack/data/venv/lib/python3.10/site-packages/cinderclient/client.py", line 197, in request
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver     raise exceptions.from_response(resp, body)
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found.
Nov 14 12:38:44 user nova-compute[75258]: ERROR nova.virt.libvirt.driver 
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server [None req-c97a576c-8f19-4a99-81d7-06ff74deb52a tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] Exception during message handling: KeyError: 'type'
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4517, in volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_delete(context, instance, volume_id,
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3853, in volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3850, in volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_delete(context, instance, volume_id,
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3680, in _volume_snapshot_delete
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     if delete_info['type'] != 'qcow2':
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server KeyError: 'type'
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server 
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server [None req-170dfb0b-25d0-4b00-af5f-c76fe8d8030b tempest-VolumesAssistedSnapshotsTest-1518672601 tempest-VolumesAssistedSnapshotsTest-1518672601-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server Traceback (most recent call last):
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 165, in _process_incoming
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     res = self.dispatcher.dispatch(message)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     return self._do_dispatch(endpoint, method, ctxt, args)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     result = func(ctxt, **new_args)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_messaging/rpc/server.py", line 244, in inner
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     return func(*args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     return f(self, context, *args, **kw)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/compute/manager.py", line 4505, in volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self.driver.volume_snapshot_create(context, instance, volume_id,
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3597, in volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     with excutils.save_and_reraise_exception():
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 227, in __exit__
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self.force_reraise()
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/oslo_utils/excutils.py", line 200, in force_reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     raise self.value
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3594, in volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self._volume_snapshot_create(context, instance, guest,
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3544, in _volume_snapshot_create
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     guest.snapshot(snapshot, no_metadata=True, disk_only=True,
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 569, in snapshot
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     self._domain.snapshotCreateXML(device_xml, flags=flags)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 193, in doit
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     result = proxy_call(self._autowrap, f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 151, in proxy_call
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     rv = execute(f, *args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 132, in execute
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     six.reraise(c, e, tb)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/six.py", line 719, in reraise
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     raise value
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/opt/stack/data/venv/lib/python3.10/site-packages/eventlet/tpool.py", line 86, in tworker
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     rv = meth(*args, **kwargs)
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server   File "/usr/lib/python3/dist-packages/libvirt.py", line 3070, in snapshotCreateXML
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server     raise libvirtError('virDomainSnapshotCreateXML() failed')
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory
Nov 14 12:38:44 user nova-compute[75258]: ERROR oslo_messaging.rpc.server 
Nov 14 12:38:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:45 user nova-compute[75258]: INFO nova.compute.manager [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Detaching volume f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:38:45 user nova-compute[75258]: INFO nova.virt.block_device [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Attempting to driver detach volume f01e8bed-844a-4928-8d6a-bee0dfc1684c from mountpoint /dev/vdb
Nov 14 12:38:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Attempting to detach device vdb from instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:38:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:45 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:45 user nova-compute[75258]:   <source dev="/dev/sdi"/>
Nov 14 12:38:45 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:45 user nova-compute[75258]:   <serial>f01e8bed-844a-4928-8d6a-bee0dfc1684c</serial>
Nov 14 12:38:45 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:38:45 user nova-compute[75258]: </disk>
Nov 14 12:38:45 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Successfully detached device vdb from instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f from the persistent domain config.
Nov 14 12:38:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:38:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] detach device xml: <disk type="block" device="disk">
Nov 14 12:38:45 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:38:45 user nova-compute[75258]:   <source dev="/dev/sdi"/>
Nov 14 12:38:45 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:38:45 user nova-compute[75258]:   <serial>f01e8bed-844a-4928-8d6a-bee0dfc1684c</serial>
Nov 14 12:38:45 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:38:45 user nova-compute[75258]: </disk>
Nov 14 12:38:45 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:38:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:38:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3121053b-59aa-4412-aee7-a4b54d99d50d is timed out.
Nov 14 12:38:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Successfully detached device vdb from instance 3121053b-59aa-4412-aee7-a4b54d99d50d from the live domain config.
Nov 14 12:38:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'voBfbpjX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:46 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af259b5-b6ac-4310-b18f-5880fd1e6b78]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:38:46 user nova-compute[75258]: No targets found.
Nov 14 12:38:46 user nova-compute[75258]: iSNS:
Nov 14 12:38:46 user nova-compute[75258]: No targets found.
Nov 14 12:38:46 user nova-compute[75258]: STATIC:
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:38:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:46 user nova-compute[75258]: FIRMWARE:
Nov 14 12:38:46 user nova-compute[75258]: No targets found.
Nov 14 12:38:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:38:46 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:38:46 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1cc7579-ea84-47a1-8ec4-333eaa38a052]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca34bb39-1de9-469f-87e7-ffa86b53b56b]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c765120>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4322d7d2-35e1-4799-8073-27896f55ce00]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dffed37-5f8f-4d4f-8f81-1d2b5e402a97]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b12d5e-880a-4b39-b6fe-9eabfd289f71]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cba0423-dd77-47a4-b318-bbb5b3d89ca0]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:38:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bf2197-ac66-4051-ba60-76814ccb8caa]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27dc2178-ea72-4736-9bbd-f5f8fcb62744]: (4, ('Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260]\nLogout of [sid: 7, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260]
Nov 14 12:38:47 user nova-compute[75258]: Logout of [sid: 7, target: iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:47 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2a67466-09ce-4a6f-a6d2-65334fa08eb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a1b42-b3b8-46f2-9534-5eec00c9a4e4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.315s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] <== disconnect_volume: return (317ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lazy-loading 'flavor' on Instance uuid 3121053b-59aa-4412-aee7-a4b54d99d50d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c9964472-1656-47dd-943b-c98505ac593e tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.609s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-changed-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing instance network info cache due to event network-changed-74f6b43b-1c34-4e15-ae45-7849287fb46b. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] Acquiring lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] Acquired lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Refreshing network info cache for port 74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updated VIF entry in instance network info cache for port 74f6b43b-1c34-4e15-ae45-7849287fb46b. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [{"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2f054dcf-ec61-46fd-985e-f32e27858ef9 req-c051dad8-c3be-42c9-b6b9-e90c7c849777 service nova] Releasing lock "refresh_cache-b62c235b-e019-47c3-9a0a-73dddd9df33a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-changed-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Refreshing instance network info cache due to event network-changed-7c006bb4-98c0-4f9c-9367-d76bd2595e2e. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] Acquiring lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] Acquired lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG nova.network.neutron [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Refreshing network info cache for port 7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG nova.network.neutron [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updated VIF entry in instance network info cache for port 7c006bb4-98c0-4f9c-9367-d76bd2595e2e. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG nova.network.neutron [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating instance_info_cache with network_info: [{"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-db97308e-903d-49f6-9fc4-f6d9865e15b8 req-1277689c-d714-48cb-ac30-3ede7f633763 service nova] Releasing lock "refresh_cache-80bea81e-2e5a-45d6-814a-44685e6e9d46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:54 user nova-compute[75258]: INFO nova.compute.manager [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Terminating instance
Nov 14 12:38:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1dfa5042-c5b2-4e61-9a98-0341a9242b2a req-d5d06bba-3ac7-48bb-a0de-05cd6bff504b service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1dfa5042-c5b2-4e61-9a98-0341a9242b2a req-d5d06bba-3ac7-48bb-a0de-05cd6bff504b service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1dfa5042-c5b2-4e61-9a98-0341a9242b2a req-d5d06bba-3ac7-48bb-a0de-05cd6bff504b service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1dfa5042-c5b2-4e61-9a98-0341a9242b2a req-d5d06bba-3ac7-48bb-a0de-05cd6bff504b service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1dfa5042-c5b2-4e61-9a98-0341a9242b2a req-d5d06bba-3ac7-48bb-a0de-05cd6bff504b service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-unplugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-1dfa5042-c5b2-4e61-9a98-0341a9242b2a req-d5d06bba-3ac7-48bb-a0de-05cd6bff504b service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-e8f6ca78-cca0-4f7a-9823-5fa9808547c2 req-98e3e18d-bbd3-4f57-860b-2d79a68e65d7 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8f6ca78-cca0-4f7a-9823-5fa9808547c2 req-98e3e18d-bbd3-4f57-860b-2d79a68e65d7 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8f6ca78-cca0-4f7a-9823-5fa9808547c2 req-98e3e18d-bbd3-4f57-860b-2d79a68e65d7 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8f6ca78-cca0-4f7a-9823-5fa9808547c2 req-98e3e18d-bbd3-4f57-860b-2d79a68e65d7 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-e8f6ca78-cca0-4f7a-9823-5fa9808547c2 req-98e3e18d-bbd3-4f57-860b-2d79a68e65d7 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-unplugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-e8f6ca78-cca0-4f7a-9823-5fa9808547c2 req-98e3e18d-bbd3-4f57-860b-2d79a68e65d7 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-74f6b43b-1c34-4e15-ae45-7849287fb46b for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG nova.objects.instance [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:56 user nova-compute[75258]: INFO nova.compute.manager [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attaching volume 62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 to /dev/vdb
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.utils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be1f5c9-00bc-4b87-b3be-a22ee0b00918]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d11715b-541e-4997-b663-069560547d9c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ef4b60-c74d-480e-a1aa-be9a39f5a436]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0458d05-7128-4553-acf0-e76a517b5328]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-unplugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-57365a03-7522-450d-a7dc-3bef486a0eef for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:56 user nova-compute[75258]: WARNING nova.compute.manager [req-8666ffe7-bc80-48d0-88e3-89f7eaca06e7 req-57e3cf47-b997-4e90-bc1e-ad128bc7fb54 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-57365a03-7522-450d-a7dc-3bef486a0eef for instance with vm_state active and task_state deleting.
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:38:56 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[565f362c-e7d0-4609-9a80-e6475a3d24d4]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.utils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== get_connector_properties: return (169ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating existing volume attachment record: fb69f45c-18eb-42b9-bc8c-85170a4871a7 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:38:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Instance destroyed successfully.
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lazy-loading 'resources' on Instance uuid b62c235b-e019-47c3-9a0a-73dddd9df33a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:52:84:be,bridge_name='br-int',has_traffic_filtering=True,id=74f6b43b-1c34-4e15-ae45-7849287fb46b,network=Network(a09082b3-9f89-4482-903f-76177ff62733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f6b43b-1c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:84:be,bridge_name='br-int',has_traffic_filtering=True,id=74f6b43b-1c34-4e15-ae45-7849287fb46b,network=Network(a09082b3-9f89-4482-903f-76177ff62733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f6b43b-1c') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap74f6b43b-1c, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7102d8a8-101f-4d87-86fa-c47845d9bbf4) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: INFO os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:52:84:be,bridge_name='br-int',has_traffic_filtering=True,id=74f6b43b-1c34-4e15-ae45-7849287fb46b,network=Network(a09082b3-9f89-4482-903f-76177ff62733),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap74f6b43b-1c')
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bd:34:15,bridge_name='br-int',has_traffic_filtering=True,id=a178791c-2e59-45d7-a0c2-4a7482ee3cef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa178791c-2e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:34:15,bridge_name='br-int',has_traffic_filtering=True,id=a178791c-2e59-45d7-a0c2-4a7482ee3cef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa178791c-2e') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa178791c-2e, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Waiting for libvirt event about the detach of device sdc with device alias scsi0-0-0-2 from instance f8188411-19c7-4ca9-adb1-3dbf7a994566 is timed out.
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6345ef03-90c1-4334-9a6b-65179a1e86d3) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Successfully detached device sdc from instance f8188411-19c7-4ca9-adb1-3dbf7a994566 from the live domain config.
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yVsUDNHE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad2d905-1c69-48f0-a69c-a9c8e028f8db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:38:56 user nova-compute[75258]: No targets found.
Nov 14 12:38:56 user nova-compute[75258]: iSNS:
Nov 14 12:38:56 user nova-compute[75258]: No targets found.
Nov 14 12:38:56 user nova-compute[75258]: STATIC:
Nov 14 12:38:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:38:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913
Nov 14 12:38:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed
Nov 14 12:38:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884
Nov 14 12:38:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261
Nov 14 12:38:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850
Nov 14 12:38:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:38:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:56 user nova-compute[75258]: FIRMWARE:
Nov 14 12:38:56 user nova-compute[75258]: No targets found.
Nov 14 12:38:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:38:56 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:38:56 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a203501-4311-46c5-a741-e84588a1c45c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: INFO os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bd:34:15,bridge_name='br-int',has_traffic_filtering=True,id=a178791c-2e59-45d7-a0c2-4a7482ee3cef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa178791c-2e')
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:65:9b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8d3cd6fd-ea40-437f-a094-b021d4d3133e,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d3cd6fd-ea') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8d3cd6fd-ea40-437f-a094-b021d4d3133e,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d3cd6fd-ea') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d3cd6fd-ea, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[097b460f-76fd-40a6-80e6-69566f4d9671]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4ac111a20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884'): ({'sdg'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Removing single pathed devices sdg {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf2852-d431-4763-b863-e562ef696620]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ac70b72-43e2-4928-8b72-9e7efa3e6364) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea62b8d-7843-404d-bf9e-b8d190a2c4aa]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Flushing IO for device /dev/sdg {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[25eba982-6019-4a78-afa0-4a12719a83ff]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: INFO os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:65:9b:2a,bridge_name='br-int',has_traffic_filtering=True,id=8d3cd6fd-ea40-437f-a094-b021d4d3133e,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap8d3cd6fd-ea')
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:49:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=57365a03-7522-450d-a7dc-3bef486a0eef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57365a03-75') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=57365a03-7522-450d-a7dc-3bef486a0eef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57365a03-75') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap57365a03-75, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.043s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d103b0a-6d86-48e4-8d9f-7a9b0af80ea8]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=72b8b18e-3beb-4a4a-85ff-7b020be5f6d8) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6fa3a0-ac99-44c2-a297-94c8a99053f8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: INFO os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:49:c9:ad,bridge_name='br-int',has_traffic_filtering=True,id=57365a03-7522-450d-a7dc-3bef486a0eef,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap57365a03-75')
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:46:65:99,bridge_name='br-int',has_traffic_filtering=True,id=1dd5d8e3-53ee-4b4c-8872-f6ef644359ec,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd5d8e3-53') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:65:99,bridge_name='br-int',has_traffic_filtering=True,id=1dd5d8e3-53ee-4b4c-8872-f6ef644359ec,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd5d8e3-53') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1dd5d8e3-53, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5b0e58d1-ba0a-4a51-b486-e31592d8e01f) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7378df9-5bc0-4205-b37b-27bbe1af426a]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260]
Nov 14 12:38:57 user nova-compute[75258]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: INFO os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:46:65:99,bridge_name='br-int',has_traffic_filtering=True,id=1dd5d8e3-53ee-4b4c-8872-f6ef644359ec,network=Network(6ce52ad8-b531-40cf-aa26-d1e0435b6dcf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1dd5d8e3-53')
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:16:f9:15,bridge_name='br-int',has_traffic_filtering=True,id=d833c545-9c52-4de6-b38b-13b22a2af860,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd833c545-9c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f9:15,bridge_name='br-int',has_traffic_filtering=True,id=d833c545-9c52-4de6-b38b-13b22a2af860,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd833c545-9c') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd833c545-9c, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0d86c291-45ae-4e52-a965-b53b1d168884 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc91e6b2-0036-4dff-9e2f-54abc21413f3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.350s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] <== disconnect_volume: return (351ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3410a39b-aba8-4d47-b2c7-20a41112b4c0) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: INFO os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:16:f9:15,bridge_name='br-int',has_traffic_filtering=True,id=d833c545-9c52-4de6-b38b-13b22a2af860,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd833c545-9c')
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:37:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-2098534097',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-2098534097',id=9,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFonrpd5GodAs9XmyrZ6BYiTy1eW6hd5b5mD2Gw1vlAdxacwA2cIyLfZcBmf6Hh1ri7FvMTLWdYoPiQWEArKyv25LDjGejdorL6DaNYAkeNAv/2H6Q1jzIC7l5VKkWWuqQ==',key_name='tempest-keypair-756373862',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a998aaf65ac04373a7c84672e57a48de',ramdisk_id='',reservation_id='r-3mzv06kk',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-494654149',owner_user_name='tempest-TaggedBootDevicesTest_v242-494654149-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5b9aaf357d494d30bdc4647a6067e4f0',uuid=b62c235b-e019-47c3-9a0a-73dddd9df33a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converting VIF {"id": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "address": "fa:16:3e:62:ce:70", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape73ab2bb-5a", "ovs_interfaceid": "e73ab2bb-5a2a-4c94-8356-217ead114bef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:62:ce:70,bridge_name='br-int',has_traffic_filtering=True,id=e73ab2bb-5a2a-4c94-8356-217ead114bef,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73ab2bb-5a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ce:70,bridge_name='br-int',has_traffic_filtering=True,id=e73ab2bb-5a2a-4c94-8356-217ead114bef,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73ab2bb-5a') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape73ab2bb-5a, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bc8749c6-6357-409d-b7fc-a54fce389fa1) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:57 user nova-compute[75258]: INFO os_vif [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:62:ce:70,bridge_name='br-int',has_traffic_filtering=True,id=e73ab2bb-5a2a-4c94-8356-217ead114bef,network=Network(0e27348c-db50-482b-bcd2-dd504022da3a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape73ab2bb-5a')
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vtjwnMZD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a985d-f3d5-43ba-beea-c3b4b80710f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]: iSNS:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]: STATIC:
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: FIRMWARE:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:38:57 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:38:57 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1a8549-08c0-483a-b200-09ea748dc89f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-a178791c-2e59-45d7-a0c2-4a7482ee3cef for instance with vm_state active and task_state deleting.
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-unplugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-d833c545-9c52-4de6-b38b-13b22a2af860 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING nova.compute.manager [req-a4c7aee4-7f31-4ccd-b6b1-ffcb65c3a474 req-af964efb-351c-4343-95ec-e6f318936975 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-d833c545-9c52-4de6-b38b-13b22a2af860 for instance with vm_state active and task_state deleting.
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[86686ddb-9d94-4335-b65b-f5069421d0b9]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b430e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[64424daf-32cd-4e9f-a6bc-2fad23420304]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1893a143-f411-4127-a194-f44254c8e114]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-74f6b43b-1c34-4e15-ae45-7849287fb46b for instance with vm_state active and task_state deleting.
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-unplugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-8d3cd6fd-ea40-437f-a094-b021d4d3133e for instance with vm_state active and task_state deleting.
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-unplugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec for instance with vm_state active and task_state deleting.
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-unplugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-unplugged-e73ab2bb-5a2a-4c94-8356-217ead114bef for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Acquiring lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] No waiting events found dispatching network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING nova.compute.manager [req-8636f390-c2b6-4ef2-a355-caf63c0e4f99 req-1276f2bd-12e4-4188-a072-1c957176d222 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received unexpected event network-vif-plugged-e73ab2bb-5a2a-4c94-8356-217ead114bef for instance with vm_state active and task_state deleting.
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc8bc660-8f7d-4732-ab67-f255dce47ab7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ded9685-3eae-4085-9627-339f4f8710bf]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[700fec7c-f520-47a0-9201-9c7d6a72adbe]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4781b71b-7a93-4076-a79a-1864aeb01f46]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260]
Nov 14 12:38:57 user nova-compute[75258]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:969ba583-c420-4d75-ab00-f175212d21ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2e46cdf-9a77-4cb7-8b09-89465016bdc6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== disconnect_volume: return (314ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mYDyrEpS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2bb86b8-07b7-4a25-9679-8e5af6aca350]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]: iSNS:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]: STATIC:
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: FIRMWARE:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:38:57 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:38:57 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb0bd1a-2276-48d1-b8fb-465d475be815]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61dd2cf-c647-4c8e-a8f8-5366bd33c6de]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c78f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913'): ({'sdc'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Removing single pathed devices sdc {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6478f619-1998-4b9f-b73e-cffc3577ea00]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5f6a2af-f3b3-4362-8e78-24e501a467d9]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Flushing IO for device /dev/sdc {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[945dcc0d-27a3-4ab8-ad37-b8f0fa90c077]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[46bd5f7e-fc7c-4982-aa97-168cded26f3c]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[557d45fc-5cfb-479f-9a57-8d7bde2077dd]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c48cdd-7e94-44ce-8673-2873150afa68]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260]
Nov 14 12:38:57 user nova-compute[75258]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:222e7d3c-7457-4188-839d-82abdf5a0913 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfb26c6a-f1a3-4f08-bc51-ae8e2a362e8c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.305s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== disconnect_volume: return (306ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TkCEuyhs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:38:57 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eed2707-4f79-47dc-9fc7-b2a23d9cb45d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]: iSNS:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]: STATIC:
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:38:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:38:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:38:57 user nova-compute[75258]: FIRMWARE:
Nov 14 12:38:57 user nova-compute[75258]: No targets found.
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:38:57 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:38:57 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e47c783-d8f0-4292-9caf-78475501b36e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG nova.objects.instance [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lazy-loading 'flavor' on Instance uuid f8188411-19c7-4ca9-adb1-3dbf7a994566 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[99e7ff02-4b14-414f-a260-10931a82582d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:38:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b46d6c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-48076a54-9d80-4446-b09e-4313f82cd87b tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.705s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4606684-4633-459f-9e5f-99c8e48d150d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e085966-cb3b-41bd-906e-ca0c6065ce19]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ec31b7-0db1-45f2-9d97-249d9ea1475a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:38:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32cbd66-8246-4040-8698-8916b0088dba]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.035s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f56df7-08f1-42e0-9bf4-69dfb629f902]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45403700-a950-49ec-8bf8-dc5fc5a9e5e4]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260]
Nov 14 12:38:58 user nova-compute[75258]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850, portal: 172.16.0.220,3260] successful.
Nov 14 12:38:58 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f4840ce4-6574-4c32-b313-ca5249a39850 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f7aeacb-a9dd-47dd-bc4d-c40b39616a5b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] <== disconnect_volume: return (337ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:38:58 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Deleting instance files /opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a_del
Nov 14 12:38:58 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Deletion of /opt/stack/data/nova/instances/b62c235b-e019-47c3-9a0a-73dddd9df33a_del complete
Nov 14 12:38:58 user nova-compute[75258]: INFO nova.compute.manager [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Took 3.50 seconds to destroy the instance on the hypervisor.
Nov 14 12:38:58 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:38:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:59 user nova-compute[75258]: INFO nova.compute.manager [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Terminating instance
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-b2723045-709e-4d9b-813b-639db55b1732 req-c17d4d3a-62c6-4a97-8017-b6dd29216f2b service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-vif-unplugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b2723045-709e-4d9b-813b-639db55b1732 req-c17d4d3a-62c6-4a97-8017-b6dd29216f2b service nova] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b2723045-709e-4d9b-813b-639db55b1732 req-c17d4d3a-62c6-4a97-8017-b6dd29216f2b service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b2723045-709e-4d9b-813b-639db55b1732 req-c17d4d3a-62c6-4a97-8017-b6dd29216f2b service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-b2723045-709e-4d9b-813b-639db55b1732 req-c17d4d3a-62c6-4a97-8017-b6dd29216f2b service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] No waiting events found dispatching network-vif-unplugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-b2723045-709e-4d9b-813b-639db55b1732 req-c17d4d3a-62c6-4a97-8017-b6dd29216f2b service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-vif-unplugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:38:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Instance destroyed successfully.
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lazy-loading 'resources' on Instance uuid f8188411-19c7-4ca9-adb1-3dbf7a994566 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-ddaded5e-2b97-4741-9e40-b7f479534353 req-efefdd13-741a-4dfb-8438-bf47a14fd7a6 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-deleted-e73ab2bb-5a2a-4c94-8356-217ead114bef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:38:59 user nova-compute[75258]: INFO nova.compute.manager [req-ddaded5e-2b97-4741-9e40-b7f479534353 req-efefdd13-741a-4dfb-8438-bf47a14fd7a6 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Neutron deleted interface e73ab2bb-5a2a-4c94-8356-217ead114bef; detaching it from the instance and deleting it from the info cache
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.network.neutron [req-ddaded5e-2b97-4741-9e40-b7f479534353 req-efefdd13-741a-4dfb-8438-bf47a14fd7a6 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [{"id": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "address": "fa:16:3e:52:84:be", "network": {"id": "a09082b3-9f89-4482-903f-76177ff62733", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1693365071-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap74f6b43b-1c", "ovs_interfaceid": "74f6b43b-1c34-4e15-ae45-7849287fb46b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "address": "fa:16:3e:bd:34:15", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.165", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa178791c-2e", "ovs_interfaceid": "a178791c-2e59-45d7-a0c2-4a7482ee3cef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "address": "fa:16:3e:65:9b:2a", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.37", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d3cd6fd-ea", "ovs_interfaceid": "8d3cd6fd-ea40-437f-a094-b021d4d3133e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "57365a03-7522-450d-a7dc-3bef486a0eef", "address": "fa:16:3e:49:c9:ad", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.189", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap57365a03-75", "ovs_interfaceid": "57365a03-7522-450d-a7dc-3bef486a0eef", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "address": "fa:16:3e:46:65:99", "network": {"id": "6ce52ad8-b531-40cf-aa26-d1e0435b6dcf", "bridge": "br-int", "label": "tempest-device-tagging-net1-949373557", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1dd5d8e3-53", "ovs_interfaceid": "1dd5d8e3-53ee-4b4c-8872-f6ef644359ec", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "d833c545-9c52-4de6-b38b-13b22a2af860", "address": "fa:16:3e:16:f9:15", "network": {"id": "0e27348c-db50-482b-bcd2-dd504022da3a", "bridge": "br-int", "label": "tempest-device-tagging-net2-1568694090", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "a998aaf65ac04373a7c84672e57a48de", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd833c545-9c", "ovs_interfaceid": "d833c545-9c52-4de6-b38b-13b22a2af860", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-245524799',display_name='tempest-AttachSCSIVolumeTestJSON-server-245524799',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-245524799',id=6,image_ref='4650c19d-913f-47f6-b78c-41fba6eb31f6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHleU03DPSJZli4+3GQgOMPg56aRm2Y8uX3ngxNMVzvUgaTEHQjeYi07qCkqDAvaSU4gF3/I3pUKodyVge0gMUmU4KOh7+lZYepIGzBkHPPSY/Bu6M0JuTiX219XMjwupA==',key_name='tempest-keypair-1265328470',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:47Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0b9f769d042e4faa8908f32760ccd869',ramdisk_id='',reservation_id='r-us2rv6a3',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='4650c19d-913f-47f6-b78c-41fba6eb31f6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1898185931',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1898185931-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f9758dc3df3342948924d8c0b85abd3b',uuid=f8188411-19c7-4ca9-adb1-3dbf7a994566,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Converting VIF {"id": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "address": "fa:16:3e:d1:03:aa", "network": {"id": "53009b8b-cf02-46a9-b29b-8bbdf217ef0d", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-906650107-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.182", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "0b9f769d042e4faa8908f32760ccd869", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap80453c54-c7", "ovs_interfaceid": "80453c54-c7d6-4bf7-8cbd-f9956a9c52d5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d1:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5,network=Network(53009b8b-cf02-46a9-b29b-8bbdf217ef0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80453c54-c7') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG os_vif [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5,network=Network(53009b8b-cf02-46a9-b29b-8bbdf217ef0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80453c54-c7') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap80453c54-c7, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b436bdd2-0b94-4d7b-8e69-8e1a78690937) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-ddaded5e-2b97-4741-9e40-b7f479534353 req-efefdd13-741a-4dfb-8438-bf47a14fd7a6 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Detach interface failed, port_id=e73ab2bb-5a2a-4c94-8356-217ead114bef, reason: Instance b62c235b-e019-47c3-9a0a-73dddd9df33a could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:38:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:38:59 user nova-compute[75258]: INFO os_vif [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d1:03:aa,bridge_name='br-int',has_traffic_filtering=True,id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5,network=Network(53009b8b-cf02-46a9-b29b-8bbdf217ef0d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap80453c54-c7')
Nov 14 12:38:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Deleting instance files /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566_del
Nov 14 12:38:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Deletion of /opt/stack/data/nova/instances/f8188411-19c7-4ca9-adb1-3dbf7a994566_del complete
Nov 14 12:39:00 user nova-compute[75258]: INFO nova.compute.manager [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:39:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d is timed out.
Nov 14 12:39:00 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully detached device vdb from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the live domain config.
Nov 14 12:39:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ybxsIvtq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:00 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43b42b63-28ea-43e0-8b69-a8a4a97091e1]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:39:00 user nova-compute[75258]: No targets found.
Nov 14 12:39:00 user nova-compute[75258]: iSNS:
Nov 14 12:39:00 user nova-compute[75258]: No targets found.
Nov 14 12:39:00 user nova-compute[75258]: STATIC:
Nov 14 12:39:00 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:39:00 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:00 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:00 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261
Nov 14 12:39:00 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:00 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:00 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:39:00 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:00 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:00 user nova-compute[75258]: FIRMWARE:
Nov 14 12:39:00 user nova-compute[75258]: No targets found.
Nov 14 12:39:00 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:39:00 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:39:00 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[90269c82-b962-4a8f-aa1e-ce8dd48d9d51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6ea373-54cb-441b-aa08-560c138cc235]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:00 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:00 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:39:00 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:00 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:00 user nova-compute[75258]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 (non-flash)
Nov 14 12:39:00 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c78fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261'): ({'sdh'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Removing single pathed devices sdh {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[418892ab-7f98-4874-81db-37679342e755]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3929c1c-f1b3-4432-8580-e277e2bcdc48]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Flushing IO for device /dev/sdh {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ef019b-9b7d-446e-a85c-a5e1ec110971]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.049s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b64dab-be3c-4368-bcbe-4b10ae49aca8]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] SCSI volumes sdh have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:39:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f681457b-3a6c-487e-8875-86651019ffac]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb7dbd8-9afb-4ba0-9db4-5e090fa972e3]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260]
Nov 14 12:39:01 user nova-compute[75258]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7da99084-1473-4316-97cc-626411cc4261 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32647984-6ed3-460d-9b3b-14d32653fa6c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.337s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] <== disconnect_volume: return (338ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ILYplyVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:01 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:01 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:01 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[002c2624-3a63-4a77-b7e5-40ae24c57370]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:39:01 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8872d8-d6b3-45d1-a952-95d15a346b61]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8] added
Nov 14 12:39:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a4ef92-cad3-4a2a-8c22-881d977c680d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Took 1.39 seconds to deallocate network for instance.
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-48887522-b51e-436d-a524-e19377d4f6ac req-42ad7cbe-000a-4d02-a9cf-18560cb37468 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-vif-deleted-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:01 user nova-compute[75258]: INFO nova.compute.manager [req-48887522-b51e-436d-a524-e19377d4f6ac req-42ad7cbe-000a-4d02-a9cf-18560cb37468 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Neutron deleted interface 80453c54-c7d6-4bf7-8cbd-f9956a9c52d5; detaching it from the instance and deleting it from the info cache
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-48887522-b51e-436d-a524-e19377d4f6ac req-42ad7cbe-000a-4d02-a9cf-18560cb37468 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-48887522-b51e-436d-a524-e19377d4f6ac req-42ad7cbe-000a-4d02-a9cf-18560cb37468 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Detach interface failed, port_id=80453c54-c7d6-4bf7-8cbd-f9956a9c52d5, reason: Instance f8188411-19c7-4ca9-adb1-3dbf7a994566 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9761c66c-2f1d-45e4-8de4-c0906c7dec66]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ILYplyVZ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ILYplyVZ" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f68696-a9be-4a0d-8b3b-d76b27b62162]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ILYplyVZ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4fcbcff-e262-47c7-b1e4-ce55ae7c029a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cb9b494-054e-417e-8922-00129972e258]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:01 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:01 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-96dc263c-6ab8-409f-9a11-341c42febe0a req-708e440c-b61e-4fa1-b1b5-1d0a85efb044 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received event network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-96dc263c-6ab8-409f-9a11-341c42febe0a req-708e440c-b61e-4fa1-b1b5-1d0a85efb044 service nova] Acquiring lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-96dc263c-6ab8-409f-9a11-341c42febe0a req-708e440c-b61e-4fa1-b1b5-1d0a85efb044 service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-96dc263c-6ab8-409f-9a11-341c42febe0a req-708e440c-b61e-4fa1-b1b5-1d0a85efb044 service nova] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-96dc263c-6ab8-409f-9a11-341c42febe0a req-708e440c-b61e-4fa1-b1b5-1d0a85efb044 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] No waiting events found dispatching network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:01 user nova-compute[75258]: WARNING nova.compute.manager [req-96dc263c-6ab8-409f-9a11-341c42febe0a req-708e440c-b61e-4fa1-b1b5-1d0a85efb044 service nova] [instance: f8188411-19c7-4ca9-adb1-3dbf7a994566] Received unexpected event network-vif-plugged-80453c54-c7d6-4bf7-8cbd-f9956a9c52d5 for instance with vm_state deleted and task_state None.
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0411cbc5-a4e3-4abd-874f-d4887eb8c346]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260]
Nov 14 12:39:01 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Took 3.38 seconds to deallocate network for instance.
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ab5ba1-cce9-4a18-877d-8500637f7d2d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca6b9942-fd13-4a31-be9a-c4dd47883e4d]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:01 user nova-compute[75258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:01 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:01 user nova-compute[75258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:01 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.383s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] HCTL ('33', '-', '-', 0) found on session 11 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c765a3d-f79f-4b7d-af0a-759b64b0595b]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Searching for a device in session 11 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ILYplyVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:01 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Deleted allocations for instance f8188411-19c7-4ca9-adb1-3dbf7a994566
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-25faa2ba-c836-4051-9b10-286fde54ace9 req-50c29630-eb73-42ac-a785-a36bf0c85811 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-deleted-74f6b43b-1c34-4e15-ae45-7849287fb46b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-25faa2ba-c836-4051-9b10-286fde54ace9 req-50c29630-eb73-42ac-a785-a36bf0c85811 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-deleted-57365a03-7522-450d-a7dc-3bef486a0eef {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-25faa2ba-c836-4051-9b10-286fde54ace9 req-50c29630-eb73-42ac-a785-a36bf0c85811 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-deleted-1dd5d8e3-53ee-4b4c-8872-f6ef644359ec {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-25faa2ba-c836-4051-9b10-286fde54ace9 req-50c29630-eb73-42ac-a785-a36bf0c85811 service nova] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Received event network-vif-deleted-d833c545-9c52-4de6-b38b-13b22a2af860 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:01 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'flavor' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3338f4c2-5d80-4cd3-8cde-0ec4246707a8 tempest-AttachSCSIVolumeTestJSON-1898185931 tempest-AttachSCSIVolumeTestJSON-1898185931-project-member] Lock "f8188411-19c7-4ca9-adb1-3dbf7a994566" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.914s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f4aac5e1-a92f-4c6d-92ba-1f7205452b83 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.804s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.416s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== connect_volume: return (1417ms) {'type': 'block', 'scsi_wwn': '23238633238313134', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23238633238313134', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:39:02 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:02 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:39:02 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:39:02 user nova-compute[75258]:   <serial>62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8</serial>
Nov 14 12:39:02 user nova-compute[75258]: </disk>
Nov 14 12:39:02 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "interface-fda05899-30ea-43b3-9191-f0a4a5bbba4d-25ecabbe-697f-4a21-b558-f3d67d0bcf47" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "interface-fda05899-30ea-43b3-9191-f0a4a5bbba4d-25ecabbe-697f-4a21-b558-f3d67d0bcf47" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'flavor' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converting VIF {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface> {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface> {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Attempting to detach device tap25ecabbe-69 from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] detach device xml: <interface type="ethernet">
Nov 14 12:39:02 user nova-compute[75258]:   <mac address="fa:16:3e:26:a2:69"/>
Nov 14 12:39:02 user nova-compute[75258]:   <model type="virtio"/>
Nov 14 12:39:02 user nova-compute[75258]:   <mtu size="1442"/>
Nov 14 12:39:02 user nova-compute[75258]:   <target dev="tap25ecabbe-69"/>
Nov 14 12:39:02 user nova-compute[75258]: </interface>
Nov 14 12:39:02 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface> {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 12:39:02 user nova-compute[75258]:   <name>instance-00000007</name>
Nov 14 12:39:02 user nova-compute[75258]:   <uuid>fda05899-30ea-43b3-9191-f0a4a5bbba4d</uuid>
Nov 14 12:39:02 user nova-compute[75258]:   <metadata>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:02 user nova-compute[75258]:   <nova:package version="0.0.0"/>
Nov 14 12:39:02 user nova-compute[75258]:   <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:39:02 user nova-compute[75258]:   <nova:creationTime>2023-11-14 12:38:31</nova:creationTime>
Nov 14 12:39:02 user nova-compute[75258]:   <nova:flavor name="m1.tiny">
Nov 14 12:39:02 user nova-compute[75258]:     <nova:memory>512</nova:memory>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:disk>1</nova:disk>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:swap>0</nova:swap>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:02 user nova-compute[75258]:   </nova:flavor>
Nov 14 12:39:02 user nova-compute[75258]:   <nova:owner>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:39:02 user nova-compute[75258]:   </nova:owner>
Nov 14 12:39:02 user nova-compute[75258]:   <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:02 user nova-compute[75258]:   <nova:ports>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:39:02 user nova-compute[75258]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:39:02 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:02 user nova-compute[75258]:     <nova:port uuid="25ecabbe-697f-4a21-b558-f3d67d0bcf47">
Nov 14 12:39:02 user nova-compute[75258]:       <nova:ip type="fixed" address="10.10.10.197" ipVersion="4"/>
Nov 14 12:39:02 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:02 user nova-compute[75258]:   </nova:ports>
Nov 14 12:39:02 user nova-compute[75258]: </nova:instance>
Nov 14 12:39:02 user nova-compute[75258]:   </metadata>
Nov 14 12:39:02 user nova-compute[75258]:   <memory unit='KiB'>524288</memory>
Nov 14 12:39:02 user nova-compute[75258]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 12:39:02 user nova-compute[75258]:   <vcpu placement='static'>1</vcpu>
Nov 14 12:39:02 user nova-compute[75258]:   <resource>
Nov 14 12:39:02 user nova-compute[75258]:     <partition>/machine</partition>
Nov 14 12:39:02 user nova-compute[75258]:   </resource>
Nov 14 12:39:02 user nova-compute[75258]:   <sysinfo type='smbios'>
Nov 14 12:39:02 user nova-compute[75258]:     <system>
Nov 14 12:39:02 user nova-compute[75258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 12:39:02 user nova-compute[75258]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 12:39:02 user nova-compute[75258]:       <entry name='version'>0.0.0</entry>
Nov 14 12:39:02 user nova-compute[75258]:       <entry name='serial'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:02 user nova-compute[75258]:       <entry name='uuid'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:02 user nova-compute[75258]:       <entry name='family'>Virtual Machine</entry>
Nov 14 12:39:02 user nova-compute[75258]:     </system>
Nov 14 12:39:02 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:02 user nova-compute[75258]:   <os>
Nov 14 12:39:02 user nova-compute[75258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 12:39:02 user nova-compute[75258]:     <boot dev='hd'/>
Nov 14 12:39:02 user nova-compute[75258]:     <smbios mode='sysinfo'/>
Nov 14 12:39:02 user nova-compute[75258]:   </os>
Nov 14 12:39:02 user nova-compute[75258]:   <features>
Nov 14 12:39:02 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:02 user nova-compute[75258]:     <apic/>
Nov 14 12:39:02 user nova-compute[75258]:     <vmcoreinfo state='on'/>
Nov 14 12:39:02 user nova-compute[75258]:   </features>
Nov 14 12:39:02 user nova-compute[75258]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 12:39:02 user nova-compute[75258]:     <model fallback='forbid'>Nehalem</model>
Nov 14 12:39:02 user nova-compute[75258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 12:39:02 user nova-compute[75258]:     <feature policy='require' name='vme'/>
Nov 14 12:39:02 user nova-compute[75258]:     <feature policy='require' name='x2apic'/>
Nov 14 12:39:02 user nova-compute[75258]:     <feature policy='require' name='hypervisor'/>
Nov 14 12:39:02 user nova-compute[75258]:   </cpu>
Nov 14 12:39:02 user nova-compute[75258]:   <clock offset='utc'>
Nov 14 12:39:02 user nova-compute[75258]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 12:39:02 user nova-compute[75258]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 12:39:02 user nova-compute[75258]:     <timer name='hpet' present='no'/>
Nov 14 12:39:02 user nova-compute[75258]:   </clock>
Nov 14 12:39:02 user nova-compute[75258]:   <on_poweroff>destroy</on_poweroff>
Nov 14 12:39:02 user nova-compute[75258]:   <on_reboot>restart</on_reboot>
Nov 14 12:39:02 user nova-compute[75258]:   <on_crash>destroy</on_crash>
Nov 14 12:39:02 user nova-compute[75258]:   <devices>
Nov 14 12:39:02 user nova-compute[75258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 12:39:02 user nova-compute[75258]:     <disk type='file' device='disk'>
Nov 14 12:39:02 user nova-compute[75258]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 12:39:02 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk' index='2'/>
Nov 14 12:39:02 user nova-compute[75258]:       <backingStore type='file' index='3'>
Nov 14 12:39:02 user nova-compute[75258]:         <format type='raw'/>
Nov 14 12:39:02 user nova-compute[75258]:         <source file='/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae'/>
Nov 14 12:39:02 user nova-compute[75258]:         <backingStore/>
Nov 14 12:39:02 user nova-compute[75258]:       </backingStore>
Nov 14 12:39:02 user nova-compute[75258]:       <target dev='vda' bus='virtio'/>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='virtio-disk0'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </disk>
Nov 14 12:39:02 user nova-compute[75258]:     <disk type='file' device='cdrom'>
Nov 14 12:39:02 user nova-compute[75258]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 12:39:02 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config' index='1'/>
Nov 14 12:39:02 user nova-compute[75258]:       <backingStore/>
Nov 14 12:39:02 user nova-compute[75258]:       <target dev='hda' bus='ide'/>
Nov 14 12:39:02 user nova-compute[75258]:       <readonly/>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='ide0-0-0'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </disk>
Nov 14 12:39:02 user nova-compute[75258]:     <controller type='usb' index='0' model='none'>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='usb'/>
Nov 14 12:39:02 user nova-compute[75258]:     </controller>
Nov 14 12:39:02 user nova-compute[75258]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='pci.0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </controller>
Nov 14 12:39:02 user nova-compute[75258]:     <controller type='ide' index='0'>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='ide'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 12:39:02 user nova-compute[75258]:     </controller>
Nov 14 12:39:02 user nova-compute[75258]:     <interface type='ethernet'>
Nov 14 12:39:02 user nova-compute[75258]:       <mac address='fa:16:3e:de:48:6b'/>
Nov 14 12:39:02 user nova-compute[75258]:       <target dev='tap84f9ac77-62'/>
Nov 14 12:39:02 user nova-compute[75258]:       <model type='virtio'/>
Nov 14 12:39:02 user nova-compute[75258]:       <mtu size='1442'/>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='net0'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </interface>
Nov 14 12:39:02 user nova-compute[75258]:     <interface type='ethernet'>
Nov 14 12:39:02 user nova-compute[75258]:       <mac address='fa:16:3e:26:a2:69'/>
Nov 14 12:39:02 user nova-compute[75258]:       <target dev='tap25ecabbe-69'/>
Nov 14 12:39:02 user nova-compute[75258]:       <model type='virtio'/>
Nov 14 12:39:02 user nova-compute[75258]:       <mtu size='1442'/>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='net1'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </interface>
Nov 14 12:39:02 user nova-compute[75258]:     <serial type='pty'>
Nov 14 12:39:02 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:02 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:02 user nova-compute[75258]:       <target type='isa-serial' port='0'>
Nov 14 12:39:02 user nova-compute[75258]:         <model name='isa-serial'/>
Nov 14 12:39:02 user nova-compute[75258]:       </target>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </serial>
Nov 14 12:39:02 user nova-compute[75258]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 12:39:02 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:02 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:02 user nova-compute[75258]:       <target type='serial' port='0'/>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </console>
Nov 14 12:39:02 user nova-compute[75258]:     <input type='mouse' bus='ps2'>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='input0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </input>
Nov 14 12:39:02 user nova-compute[75258]:     <input type='keyboard' bus='ps2'>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='input1'/>
Nov 14 12:39:02 user nova-compute[75258]:     </input>
Nov 14 12:39:02 user nova-compute[75258]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 12:39:02 user nova-compute[75258]:       <listen type='address' address='0.0.0.0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </graphics>
Nov 14 12:39:02 user nova-compute[75258]:     <audio id='1' type='none'/>
Nov 14 12:39:02 user nova-compute[75258]:     <video>
Nov 14 12:39:02 user nova-compute[75258]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='video0'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </video>
Nov 14 12:39:02 user nova-compute[75258]:     <memballoon model='virtio'>
Nov 14 12:39:02 user nova-compute[75258]:       <stats period='10'/>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='balloon0'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:02 user nova-compute[75258]:     <rng model='virtio'>
Nov 14 12:39:02 user nova-compute[75258]:       <backend model='random'>/dev/urandom</backend>
Nov 14 12:39:02 user nova-compute[75258]:       <alias name='rng0'/>
Nov 14 12:39:02 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 12:39:02 user nova-compute[75258]:     </rng>
Nov 14 12:39:02 user nova-compute[75258]:   </devices>
Nov 14 12:39:02 user nova-compute[75258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 12:39:02 user nova-compute[75258]:     <label>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</label>
Nov 14 12:39:02 user nova-compute[75258]:     <imagelabel>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</imagelabel>
Nov 14 12:39:02 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:02 user nova-compute[75258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 12:39:02 user nova-compute[75258]:     <label>+64055:+108</label>
Nov 14 12:39:02 user nova-compute[75258]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 12:39:02 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:02 user nova-compute[75258]: </domain>
Nov 14 12:39:02 user nova-compute[75258]:  {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 12:39:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully detached device tap25ecabbe-69 from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the persistent domain config.
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] (1/8): Attempting to detach device tap25ecabbe-69 with device alias net1 from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:39:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] detach device xml: <interface type="ethernet">
Nov 14 12:39:02 user nova-compute[75258]:   <mac address="fa:16:3e:26:a2:69"/>
Nov 14 12:39:02 user nova-compute[75258]:   <model type="virtio"/>
Nov 14 12:39:02 user nova-compute[75258]:   <mtu size="1442"/>
Nov 14 12:39:02 user nova-compute[75258]:   <target dev="tap25ecabbe-69"/>
Nov 14 12:39:02 user nova-compute[75258]: </interface>
Nov 14 12:39:02 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Start waiting for the detach event from libvirt for device tap25ecabbe-69 with device alias net1 for instance fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No VIF found with MAC fa:16:3e:e8:ff:7e, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-21e4f63d-b6b5-4673-98d5-85142e2f4de1 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.252s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-unplugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-unplugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:03 user nova-compute[75258]: WARNING nova.compute.manager [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received unexpected event network-vif-unplugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 for instance with vm_state active and task_state None.
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:03 user nova-compute[75258]: WARNING nova.compute.manager [req-b92244ec-8bc4-4e8e-89a5-cfc0a9526d5c req-2d26fa64-5f94-4e6f-98c4-a8eee778f5ca service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received unexpected event network-vif-plugged-25ecabbe-697f-4a21-b558-f3d67d0bcf47 for instance with vm_state active and task_state None.
Nov 14 12:39:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:04 user nova-compute[75258]: INFO nova.compute.manager [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] [instance: b62c235b-e019-47c3-9a0a-73dddd9df33a] Took 2.42 seconds to detach 3 volumes for instance.
Nov 14 12:39:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:04 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:04 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.338s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:04 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Deleted allocations for instance b62c235b-e019-47c3-9a0a-73dddd9df33a
Nov 14 12:39:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9edeec3d-db0f-480c-b6d3-0f85ca2f6147 tempest-TaggedBootDevicesTest_v242-494654149 tempest-TaggedBootDevicesTest_v242-494654149-project-member] Lock "b62c235b-e019-47c3-9a0a-73dddd9df33a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.848s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f is timed out.
Nov 14 12:39:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Successfully detached device vdb from instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f from the live domain config.
Nov 14 12:39:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DsWlIeSn', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa9fbf35-6571-4739-a496-3b9428ff4811]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:39:05 user nova-compute[75258]: No targets found.
Nov 14 12:39:05 user nova-compute[75258]: iSNS:
Nov 14 12:39:05 user nova-compute[75258]: No targets found.
Nov 14 12:39:05 user nova-compute[75258]: STATIC:
Nov 14 12:39:05 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8
Nov 14 12:39:05 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:05 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:05 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:39:05 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:05 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:05 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c
Nov 14 12:39:05 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:05 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:05 user nova-compute[75258]: FIRMWARE:
Nov 14 12:39:05 user nova-compute[75258]: No targets found.
Nov 14 12:39:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:39:05 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:39:05 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cdec8dc-8510-474b-8ede-2ba0ba35cc34]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8399f95b-039a-406e-ae16-81b680f8b098]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)\ntcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:05 user nova-compute[75258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:05 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c (non-flash)
Nov 14 12:39:05 user nova-compute[75258]: tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:05 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b43f8670>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c'): ({'sdi'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Removing single pathed devices sdi {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d55ba4a-0ee9-4027-bb9d-a4fb63192e02]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[436404d3-cf13-4ee9-8ae1-9020ae6543f8]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Flushing IO for device /dev/sdi {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[260c1d83-f740-4678-a7a0-105243ab2c38]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[225f0326-a63a-4a00-b768-659b9d34794f]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Checking to see if SCSI volumes sdi have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] SCSI volumes sdi have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92292e9-24a2-4c32-9842-9bd590777a46]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[21e6dd74-601c-4c89-ac45-9ddf58fcdda2]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260]
Nov 14 12:39:06 user nova-compute[75258]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f01e8bed-844a-4928-8d6a-bee0dfc1684c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c7ee1a8-8462-4356-b27a-a9d7a0408e75]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.296s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] <== disconnect_volume: return (296ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG nova.objects.instance [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lazy-loading 'flavor' on Instance uuid 1ec48019-6248-4bcf-8c4d-bb07d135ce3f {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fa3368d2-ddc4-4264-8396-800380733ddb tempest-VolumesAssistedSnapshotsTest-1453569306 tempest-VolumesAssistedSnapshotsTest-1453569306-project-admin] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.575s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:39:08 user nova-compute[75258]: INFO nova.compute.claims [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Claim successful on node user
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ac186509-f835-453a-b683-c6d3901babba] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.362s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:39:08 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.policy [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cef85161135e4a978dd763ae91809be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c593ba588c7f442689362cda037f95f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:39:08 user nova-compute[75258]: INFO nova.virt.block_device [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Booting with blank volume at /dev/vda
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ac186509-f835-453a-b683-c6d3901babba] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Successfully created port: 12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Successfully updated port: 12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-changed-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Refreshing instance network info cache due to event network-changed-12b52550-1a48-42c6-bd83-4241dd9e7e4e. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] Acquiring lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] Acquired lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Refreshing network info cache for port 12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "fcb3fb92-cf4c-4258-a498-b768d49c054b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.004s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:39:10 user nova-compute[75258]: INFO nova.compute.claims [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Claim successful on node user
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7831e481-94d9-444f-bfd3-dc20c2899b23 req-3ca27abb-c930-475c-bb6f-b161028be609 service nova] Releasing lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:10 user nova-compute[75258]: INFO nova.compute.manager [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Detaching volume 62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance network_info: |[{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:10 user nova-compute[75258]: INFO nova.virt.block_device [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attempting to driver detach volume 62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 from mountpoint /dev/vdb
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.588s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Attempting to detach device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:39:10 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:10 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:39:10 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:39:10 user nova-compute[75258]:   <serial>62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8</serial>
Nov 14 12:39:10 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:39:10 user nova-compute[75258]: </disk>
Nov 14 12:39:10 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config.
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:39:10 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:10 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:39:10 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:39:10 user nova-compute[75258]:   <serial>62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8</serial>
Nov 14 12:39:10 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:39:10 user nova-compute[75258]: </disk>
Nov 14 12:39:10 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:39:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.policy [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6a1cc10ee97a471680b98fcf53c94173', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '881b748cca5c4f31b10b931164e5e1aa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:39:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Creating image(s)
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "/opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "/opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "/opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk 1073741824" returned: 0 in 0.065s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Successfully created port: 1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.199s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Cannot resize image /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Ensure instance console log exists: /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Successfully updated port: 1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "refresh_cache-fcb3fb92-cf4c-4258-a498-b768d49c054b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquired lock "refresh_cache-fcb3fb92-cf4c-4258-a498-b768d49c054b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received event network-changed-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Refreshing instance network info cache due to event network-changed-1bab2bf8-d282-4d50-91ff-bc054fc2abc6. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] Acquiring lock "refresh_cache-fcb3fb92-cf4c-4258-a498-b768d49c054b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Updating instance_info_cache with network_info: [{"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Releasing lock "refresh_cache-fcb3fb92-cf4c-4258-a498-b768d49c054b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Instance network_info: |[{"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] Acquired lock "refresh_cache-fcb3fb92-cf4c-4258-a498-b768d49c054b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Refreshing network info cache for port 1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Start _get_guest_xml network_info=[{"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:39:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1887555196',display_name='tempest-VolumesActionsTest-instance-1887555196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1887555196',id=14,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='881b748cca5c4f31b10b931164e5e1aa',ramdisk_id='',reservation_id='r-5n25omax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666751966',owner_user_name='tempest-VolumesActionsTest-1666751966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:11Z,user_data=None,user_id='6a1cc10ee97a471680b98fcf53c94173',uuid=fcb3fb92-cf4c-4258-a498-b768d49c054b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converting VIF {"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:84:88,bridge_name='br-int',has_traffic_filtering=True,id=1bab2bf8-d282-4d50-91ff-bc054fc2abc6,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bab2bf8-d2') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lazy-loading 'pci_devices' on Instance uuid fcb3fb92-cf4c-4258-a498-b768d49c054b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:39:12 user nova-compute[75258]:   <uuid>fcb3fb92-cf4c-4258-a498-b768d49c054b</uuid>
Nov 14 12:39:12 user nova-compute[75258]:   <name>instance-0000000e</name>
Nov 14 12:39:12 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:39:12 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:39:12 user nova-compute[75258]:   <metadata>
Nov 14 12:39:12 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:12 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:39:12 user nova-compute[75258]:       <nova:name>tempest-VolumesActionsTest-instance-1887555196</nova:name>
Nov 14 12:39:12 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:39:12</nova:creationTime>
Nov 14 12:39:12 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:39:12 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:39:12 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:39:12 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:39:12 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:12 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:12 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:39:12 user nova-compute[75258]:       <nova:owner>
Nov 14 12:39:12 user nova-compute[75258]:         <nova:user uuid="6a1cc10ee97a471680b98fcf53c94173">tempest-VolumesActionsTest-1666751966-project-member</nova:user>
Nov 14 12:39:12 user nova-compute[75258]:         <nova:project uuid="881b748cca5c4f31b10b931164e5e1aa">tempest-VolumesActionsTest-1666751966</nova:project>
Nov 14 12:39:12 user nova-compute[75258]:       </nova:owner>
Nov 14 12:39:12 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:12 user nova-compute[75258]:       <nova:ports>
Nov 14 12:39:12 user nova-compute[75258]:         <nova:port uuid="1bab2bf8-d282-4d50-91ff-bc054fc2abc6">
Nov 14 12:39:12 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 12:39:12 user nova-compute[75258]:         </nova:port>
Nov 14 12:39:12 user nova-compute[75258]:       </nova:ports>
Nov 14 12:39:12 user nova-compute[75258]:     </nova:instance>
Nov 14 12:39:12 user nova-compute[75258]:   </metadata>
Nov 14 12:39:12 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:39:12 user nova-compute[75258]:     <system>
Nov 14 12:39:12 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:39:12 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:39:12 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:39:12 user nova-compute[75258]:       <entry name="serial">fcb3fb92-cf4c-4258-a498-b768d49c054b</entry>
Nov 14 12:39:12 user nova-compute[75258]:       <entry name="uuid">fcb3fb92-cf4c-4258-a498-b768d49c054b</entry>
Nov 14 12:39:12 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:39:12 user nova-compute[75258]:     </system>
Nov 14 12:39:12 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:12 user nova-compute[75258]:   <os>
Nov 14 12:39:12 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:39:12 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:39:12 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:39:12 user nova-compute[75258]:   </os>
Nov 14 12:39:12 user nova-compute[75258]:   <features>
Nov 14 12:39:12 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:12 user nova-compute[75258]:     <apic/>
Nov 14 12:39:12 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:39:12 user nova-compute[75258]:   </features>
Nov 14 12:39:12 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:39:12 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:39:12 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:39:12 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:39:12 user nova-compute[75258]:   </clock>
Nov 14 12:39:12 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:39:12 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:39:12 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:39:12 user nova-compute[75258]:   </cpu>
Nov 14 12:39:12 user nova-compute[75258]:   <devices>
Nov 14 12:39:12 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:39:12 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:39:12 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk"/>
Nov 14 12:39:12 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:39:12 user nova-compute[75258]:     </disk>
Nov 14 12:39:12 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:39:12 user nova-compute[75258]:       <mac address="fa:16:3e:d9:84:88"/>
Nov 14 12:39:12 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:12 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:39:12 user nova-compute[75258]:       <target dev="tap1bab2bf8-d2"/>
Nov 14 12:39:12 user nova-compute[75258]:     </interface>
Nov 14 12:39:12 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:39:12 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/console.log" append="off"/>
Nov 14 12:39:12 user nova-compute[75258]:     </serial>
Nov 14 12:39:12 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:39:12 user nova-compute[75258]:     <video>
Nov 14 12:39:12 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:12 user nova-compute[75258]:     </video>
Nov 14 12:39:12 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:39:12 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:39:12 user nova-compute[75258]:     </rng>
Nov 14 12:39:12 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:39:12 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:39:12 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:39:12 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:12 user nova-compute[75258]:   </devices>
Nov 14 12:39:12 user nova-compute[75258]: </domain>
Nov 14 12:39:12 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1887555196',display_name='tempest-VolumesActionsTest-instance-1887555196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1887555196',id=14,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='881b748cca5c4f31b10b931164e5e1aa',ramdisk_id='',reservation_id='r-5n25omax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1666751966',owner_user_name='tempest-VolumesActionsTest-1666751966-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:11Z,user_data=None,user_id='6a1cc10ee97a471680b98fcf53c94173',uuid=fcb3fb92-cf4c-4258-a498-b768d49c054b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converting VIF {"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:84:88,bridge_name='br-int',has_traffic_filtering=True,id=1bab2bf8-d282-4d50-91ff-bc054fc2abc6,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bab2bf8-d2') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG os_vif [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:84:88,bridge_name='br-int',has_traffic_filtering=True,id=1bab2bf8-d282-4d50-91ff-bc054fc2abc6,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bab2bf8-d2') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9e66a1e1-b03a-539e-8938-aab22fba5fb5', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1bab2bf8-d2, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1bab2bf8-d2, col_values=(('qos', UUID('154f0c87-7e07-42c4-b0b8-8902df5528ba')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1bab2bf8-d2, col_values=(('external_ids', {'iface-id': '1bab2bf8-d282-4d50-91ff-bc054fc2abc6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d9:84:88', 'vm-uuid': 'fcb3fb92-cf4c-4258-a498-b768d49c054b'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:12 user nova-compute[75258]: INFO os_vif [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:84:88,bridge_name='br-int',has_traffic_filtering=True,id=1bab2bf8-d282-4d50-91ff-bc054fc2abc6,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bab2bf8-d2')
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] No VIF found with MAC fa:16:3e:d9:84:88, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-99e90318-908b-4673-9791-064cac0a1691 req-2d0cf391-05ef-47d8-9f76-e1b4dc0eac1e service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received event network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-99e90318-908b-4673-9791-064cac0a1691 req-2d0cf391-05ef-47d8-9f76-e1b4dc0eac1e service nova] Acquiring lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-99e90318-908b-4673-9791-064cac0a1691 req-2d0cf391-05ef-47d8-9f76-e1b4dc0eac1e service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-99e90318-908b-4673-9791-064cac0a1691 req-2d0cf391-05ef-47d8-9f76-e1b4dc0eac1e service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-99e90318-908b-4673-9791-064cac0a1691 req-2d0cf391-05ef-47d8-9f76-e1b4dc0eac1e service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] No waiting events found dispatching network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:16 user nova-compute[75258]: WARNING nova.compute.manager [req-99e90318-908b-4673-9791-064cac0a1691 req-2d0cf391-05ef-47d8-9f76-e1b4dc0eac1e service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received unexpected event network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 for instance with vm_state building and task_state spawning.
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-e9311cb2-7642-4915-951a-11b77efdc8fa req-41cde6f3-5455-4045-b61f-03400c8a2eae service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received event network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e9311cb2-7642-4915-951a-11b77efdc8fa req-41cde6f3-5455-4045-b61f-03400c8a2eae service nova] Acquiring lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e9311cb2-7642-4915-951a-11b77efdc8fa req-41cde6f3-5455-4045-b61f-03400c8a2eae service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e9311cb2-7642-4915-951a-11b77efdc8fa req-41cde6f3-5455-4045-b61f-03400c8a2eae service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-e9311cb2-7642-4915-951a-11b77efdc8fa req-41cde6f3-5455-4045-b61f-03400c8a2eae service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] No waiting events found dispatching network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:16 user nova-compute[75258]: WARNING nova.compute.manager [req-e9311cb2-7642-4915-951a-11b77efdc8fa req-41cde6f3-5455-4045-b61f-03400c8a2eae service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received unexpected event network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 for instance with vm_state building and task_state spawning.
Nov 14 12:39:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7831MB free_disk=25.38131332397461GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:16 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Instance spawned successfully.
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Updated VIF entry in instance network info cache for port 1bab2bf8-d282-4d50-91ff-bc054fc2abc6. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Updating instance_info_cache with network_info: [{"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8279262d-8df3-4a65-a625-05e41356693e req-21a06833-b721-422f-9faf-24bc60d4e21f service nova] Releasing lock "refresh_cache-fcb3fb92-cf4c-4258-a498-b768d49c054b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:16 user nova-compute[75258]: INFO nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Took 5.51 seconds to spawn the instance on the hypervisor.
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3121053b-59aa-4412-aee7-a4b54d99d50d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance fda05899-30ea-43b3-9191-f0a4a5bbba4d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3c2491e0-6711-4e46-9290-a4e4ad834cab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4cd80282-24f6-4b44-bb13-f9586d478364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance fcb3fb92-cf4c-4258-a498-b768d49c054b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG os_brick.utils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:16 user nova-compute[75258]: INFO nova.compute.manager [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Took 6.50 seconds to build instance.
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fa9fbf3-1cb2-4290-81dd-00ffe6b5bfcb]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27ef91f-d857-4166-8673-c3106cccf667 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.614s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9268f779-da45-4b1a-8de7-5e997c2fb1af]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5007030-bb9b-4f6d-b2a2-acf991ef8c17]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab72d5c9-2d2e-42ea-92e1-bc549a86f8f2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:16 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:39:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd4d191-2699-4083-baee-0a738f98f449]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG os_brick.utils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating existing volume attachment record: e39455d0-ed8f-4c98-98eb-66a636fc0191 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.563s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-changed-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Refreshing instance network info cache due to event network-changed-e9c41aa5-5249-4e0b-8acb-4204a526efd2. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] Acquiring lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] Acquired lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Refreshing network info cache for port e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'flavor' on Instance uuid 3c2491e0-6711-4e46-9290-a4e4ad834cab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Ignoring supplied device name: /dev/vdb
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Updated VIF entry in instance network info cache for port e9c41aa5-5249-4e0b-8acb-4204a526efd2. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Updating instance_info_cache with network_info: [{"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:18 user nova-compute[75258]: INFO nova.compute.manager [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Attaching volume 69053c46-fd0f-4f28-bdcf-49d9c018a474 to /dev/vdb
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-935c9dbd-1336-45a2-9f98-dcc273dd7d50 req-ba3336cd-b59c-4111-8e36-2aa1eec5fce5 service nova] Releasing lock "refresh_cache-3c2491e0-6711-4e46-9290-a4e4ad834cab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG os_brick.utils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f101fbd4-9906-4020-b3ce-2e5f095376ef]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9df08da-ad17-4c0f-bf80-af634e7efc6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:39:18 user nova-compute[75258]: INFO nova.compute.claims [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Claim successful on node user
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b3bcee-bc47-405d-8dca-4e08ed129c5f]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee32ac9-dc93-48ec-8c0c-0c39db44d030]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:18 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:39:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a4f12c-772d-486d-abe9-01df82130c28]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG os_brick.utils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== get_connector_properties: return (151ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Updating existing volume attachment record: d8b1c9c6-71e2-492c-9f79-c47106559979 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:39:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.493s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:39:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.policy [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '61b84b06ec4247bca42431850be2d0c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5b09a067539485181c0bd2f6edb4651', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:39:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Creating image(s)
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "/opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "/opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "/opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.213s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk 1073741824" returned: 0 in 0.062s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.282s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Successfully created port: a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.271s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Checking if we can resize image /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Cannot resize image /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Ensure instance console log exists: /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Successfully updated port: a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "refresh_cache-eab53582-4a5b-4edd-bb16-c028d3abf7f7" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquired lock "refresh_cache-eab53582-4a5b-4edd-bb16-c028d3abf7f7" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received event network-changed-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Refreshing instance network info cache due to event network-changed-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] Acquiring lock "refresh_cache-eab53582-4a5b-4edd-bb16-c028d3abf7f7" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Updating instance_info_cache with network_info: [{"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Releasing lock "refresh_cache-eab53582-4a5b-4edd-bb16-c028d3abf7f7" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Instance network_info: |[{"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] Acquired lock "refresh_cache-eab53582-4a5b-4edd-bb16-c028d3abf7f7" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.neutron [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Refreshing network info cache for port a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Start _get_guest_xml network_info=[{"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:39:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-237890098',display_name='tempest-VolumesAdminNegativeTest-server-237890098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-237890098',id=15,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b09a067539485181c0bd2f6edb4651',ramdisk_id='',reservation_id='r-ow2p84an',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-746118338',owner_user_name='tempest-VolumesAdminNegativeTest-746118338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:19Z,user_data=None,user_id='61b84b06ec4247bca42431850be2d0c7',uuid=eab53582-4a5b-4edd-bb16-c028d3abf7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converting VIF {"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:52:89,bridge_name='br-int',has_traffic_filtering=True,id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22bab8f-78') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lazy-loading 'pci_devices' on Instance uuid eab53582-4a5b-4edd-bb16-c028d3abf7f7 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:39:20 user nova-compute[75258]:   <uuid>eab53582-4a5b-4edd-bb16-c028d3abf7f7</uuid>
Nov 14 12:39:20 user nova-compute[75258]:   <name>instance-0000000f</name>
Nov 14 12:39:20 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:39:20 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:39:20 user nova-compute[75258]:   <metadata>
Nov 14 12:39:20 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:20 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:39:20 user nova-compute[75258]:       <nova:name>tempest-VolumesAdminNegativeTest-server-237890098</nova:name>
Nov 14 12:39:20 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:39:20</nova:creationTime>
Nov 14 12:39:20 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:39:20 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:39:20 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:39:20 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:39:20 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:20 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:20 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:39:20 user nova-compute[75258]:       <nova:owner>
Nov 14 12:39:20 user nova-compute[75258]:         <nova:user uuid="61b84b06ec4247bca42431850be2d0c7">tempest-VolumesAdminNegativeTest-746118338-project-member</nova:user>
Nov 14 12:39:20 user nova-compute[75258]:         <nova:project uuid="a5b09a067539485181c0bd2f6edb4651">tempest-VolumesAdminNegativeTest-746118338</nova:project>
Nov 14 12:39:20 user nova-compute[75258]:       </nova:owner>
Nov 14 12:39:20 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:20 user nova-compute[75258]:       <nova:ports>
Nov 14 12:39:20 user nova-compute[75258]:         <nova:port uuid="a22bab8f-7858-4cc1-96f5-90cb6f9afcfe">
Nov 14 12:39:20 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 12:39:20 user nova-compute[75258]:         </nova:port>
Nov 14 12:39:20 user nova-compute[75258]:       </nova:ports>
Nov 14 12:39:20 user nova-compute[75258]:     </nova:instance>
Nov 14 12:39:20 user nova-compute[75258]:   </metadata>
Nov 14 12:39:20 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:39:20 user nova-compute[75258]:     <system>
Nov 14 12:39:20 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:39:20 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:39:20 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:39:20 user nova-compute[75258]:       <entry name="serial">eab53582-4a5b-4edd-bb16-c028d3abf7f7</entry>
Nov 14 12:39:20 user nova-compute[75258]:       <entry name="uuid">eab53582-4a5b-4edd-bb16-c028d3abf7f7</entry>
Nov 14 12:39:20 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:39:20 user nova-compute[75258]:     </system>
Nov 14 12:39:20 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:20 user nova-compute[75258]:   <os>
Nov 14 12:39:20 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:39:20 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:39:20 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:39:20 user nova-compute[75258]:   </os>
Nov 14 12:39:20 user nova-compute[75258]:   <features>
Nov 14 12:39:20 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:20 user nova-compute[75258]:     <apic/>
Nov 14 12:39:20 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:39:20 user nova-compute[75258]:   </features>
Nov 14 12:39:20 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:39:20 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:39:20 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:39:20 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:39:20 user nova-compute[75258]:   </clock>
Nov 14 12:39:20 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:39:20 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:39:20 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:39:20 user nova-compute[75258]:   </cpu>
Nov 14 12:39:20 user nova-compute[75258]:   <devices>
Nov 14 12:39:20 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:39:20 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:39:20 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk"/>
Nov 14 12:39:20 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:39:20 user nova-compute[75258]:     </disk>
Nov 14 12:39:20 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:39:20 user nova-compute[75258]:       <mac address="fa:16:3e:69:52:89"/>
Nov 14 12:39:20 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:20 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:39:20 user nova-compute[75258]:       <target dev="tapa22bab8f-78"/>
Nov 14 12:39:20 user nova-compute[75258]:     </interface>
Nov 14 12:39:20 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:39:20 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/console.log" append="off"/>
Nov 14 12:39:20 user nova-compute[75258]:     </serial>
Nov 14 12:39:20 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:39:20 user nova-compute[75258]:     <video>
Nov 14 12:39:20 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:20 user nova-compute[75258]:     </video>
Nov 14 12:39:20 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:39:20 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:39:20 user nova-compute[75258]:     </rng>
Nov 14 12:39:20 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:39:20 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:39:20 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:39:20 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:20 user nova-compute[75258]:   </devices>
Nov 14 12:39:20 user nova-compute[75258]: </domain>
Nov 14 12:39:20 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-237890098',display_name='tempest-VolumesAdminNegativeTest-server-237890098',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-237890098',id=15,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a5b09a067539485181c0bd2f6edb4651',ramdisk_id='',reservation_id='r-ow2p84an',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-746118338',owner_user_name='tempest-VolumesAdminNegativeTest-746118338-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:19Z,user_data=None,user_id='61b84b06ec4247bca42431850be2d0c7',uuid=eab53582-4a5b-4edd-bb16-c028d3abf7f7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converting VIF {"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:52:89,bridge_name='br-int',has_traffic_filtering=True,id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22bab8f-78') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG os_vif [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:52:89,bridge_name='br-int',has_traffic_filtering=True,id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22bab8f-78') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bcb73e79-a675-5f24-8b5f-359ab8f8e0cc', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa22bab8f-78, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa22bab8f-78, col_values=(('qos', UUID('0b4df576-4140-4b19-9f8f-72e9ddd26d5a')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa22bab8f-78, col_values=(('external_ids', {'iface-id': 'a22bab8f-7858-4cc1-96f5-90cb6f9afcfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:52:89', 'vm-uuid': 'eab53582-4a5b-4edd-bb16-c028d3abf7f7'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:21 user nova-compute[75258]: INFO os_vif [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:52:89,bridge_name='br-int',has_traffic_filtering=True,id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22bab8f-78')
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] No VIF found with MAC fa:16:3e:69:52:89, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.network.neutron [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Updated VIF entry in instance network info cache for port a22bab8f-7858-4cc1-96f5-90cb6f9afcfe. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.network.neutron [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Updating instance_info_cache with network_info: [{"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-85d39f0e-f3b9-42bf-bcae-f724026bffaf req-1c4b7f56-fa54-47c9-8ddb-5cec0ab15393 service nova] Releasing lock "refresh_cache-eab53582-4a5b-4edd-bb16-c028d3abf7f7" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:39:21 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Creating image(s)
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Ensure instance console log exists: /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Start _get_guest_xml network_info=[{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfclQLeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5cc80485-d82a-4cf9-856c-6594f6e37c7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'serial': 'f6846ab5-9d42-4ade-baa2-ed961c7c0132'}, 'device_type': 'disk', 'attachment_id': 'e39455d0-ed8f-4c98-98eb-66a636fc0191', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:39:21 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:21 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfclQLeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:21 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:21 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:21 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc9dc80-31b4-4738-97a1-8d828ebcebb8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:39:21 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[623e39eb-0f41-4977-afa4-f6e99ce8cf25]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132] added
Nov 14 12:39:21 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc397449-830f-4ce5-ba99-72e9820aef00]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3808804-d3ef-4fd2-adcc-f04905cb1823]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfclQLeh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfclQLeh" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba28419e-6ac3-4412-bc28-c4798aabbb9d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfclQLeh'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[437c3494-8ad0-4f01-843f-0c7ca1d03409]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e991e4-a9cf-4059-a11b-37db11a4b4a7]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:21 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:21 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:21 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:21 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --login" returned: 0 in 0.094s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bedc995-0bc6-4c91-96c0-602bd02fa6cf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260]
Nov 14 12:39:22 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c6379f-0c87-4784-9675-eea02ddc82c7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f9313f-58ea-48d2-97d2-55aa181eebb8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:22 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:22 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:22 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:22 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.379s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] HCTL ('34', '-', '-', 0) found on session 12 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c441aff-82b5-4c6f-a781-2dd1fe8eb624]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-ea98534f-bd49-4039-abb8-5aaa0f13a182 req-f1c1b13c-b31d-4a82-ae5b-7b0edda4fe97 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received event network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ea98534f-bd49-4039-abb8-5aaa0f13a182 req-f1c1b13c-b31d-4a82-ae5b-7b0edda4fe97 service nova] Acquiring lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ea98534f-bd49-4039-abb8-5aaa0f13a182 req-f1c1b13c-b31d-4a82-ae5b-7b0edda4fe97 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ea98534f-bd49-4039-abb8-5aaa0f13a182 req-f1c1b13c-b31d-4a82-ae5b-7b0edda4fe97 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-ea98534f-bd49-4039-abb8-5aaa0f13a182 req-f1c1b13c-b31d-4a82-ae5b-7b0edda4fe97 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] No waiting events found dispatching network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:22 user nova-compute[75258]: WARNING nova.compute.manager [req-ea98534f-bd49-4039-abb8-5aaa0f13a182 req-f1c1b13c-b31d-4a82-ae5b-7b0edda4fe97 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received unexpected event network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe for instance with vm_state building and task_state spawning.
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching for a device in session 12 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfclQLeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.412s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== connect_volume: return (1414ms) {'type': 'block', 'scsi_wwn': '23066663766383734', 'path': '/dev/sdc'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066663766383734', 'path': '/dev/sdc'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:39:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Waiting for libvirt event about the detach of device tap25ecabbe-69 with device alias net1 from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d is timed out.
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface> {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 12:39:23 user nova-compute[75258]:   <name>instance-00000007</name>
Nov 14 12:39:23 user nova-compute[75258]:   <uuid>fda05899-30ea-43b3-9191-f0a4a5bbba4d</uuid>
Nov 14 12:39:23 user nova-compute[75258]:   <metadata>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:23 user nova-compute[75258]:   <nova:package version="0.0.0"/>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:creationTime>2023-11-14 12:38:31</nova:creationTime>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:flavor name="m1.tiny">
Nov 14 12:39:23 user nova-compute[75258]:     <nova:memory>512</nova:memory>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:disk>1</nova:disk>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:swap>0</nova:swap>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:23 user nova-compute[75258]:   </nova:flavor>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:owner>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:39:23 user nova-compute[75258]:   </nova:owner>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:ports>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:39:23 user nova-compute[75258]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:39:23 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:port uuid="25ecabbe-697f-4a21-b558-f3d67d0bcf47">
Nov 14 12:39:23 user nova-compute[75258]:       <nova:ip type="fixed" address="10.10.10.197" ipVersion="4"/>
Nov 14 12:39:23 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:23 user nova-compute[75258]:   </nova:ports>
Nov 14 12:39:23 user nova-compute[75258]: </nova:instance>
Nov 14 12:39:23 user nova-compute[75258]:   </metadata>
Nov 14 12:39:23 user nova-compute[75258]:   <memory unit='KiB'>524288</memory>
Nov 14 12:39:23 user nova-compute[75258]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 12:39:23 user nova-compute[75258]:   <vcpu placement='static'>1</vcpu>
Nov 14 12:39:23 user nova-compute[75258]:   <resource>
Nov 14 12:39:23 user nova-compute[75258]:     <partition>/machine</partition>
Nov 14 12:39:23 user nova-compute[75258]:   </resource>
Nov 14 12:39:23 user nova-compute[75258]:   <sysinfo type='smbios'>
Nov 14 12:39:23 user nova-compute[75258]:     <system>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name='version'>0.0.0</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name='serial'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name='uuid'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name='family'>Virtual Machine</entry>
Nov 14 12:39:23 user nova-compute[75258]:     </system>
Nov 14 12:39:23 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:23 user nova-compute[75258]:   <os>
Nov 14 12:39:23 user nova-compute[75258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 12:39:23 user nova-compute[75258]:     <boot dev='hd'/>
Nov 14 12:39:23 user nova-compute[75258]:     <smbios mode='sysinfo'/>
Nov 14 12:39:23 user nova-compute[75258]:   </os>
Nov 14 12:39:23 user nova-compute[75258]:   <features>
Nov 14 12:39:23 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:23 user nova-compute[75258]:     <apic/>
Nov 14 12:39:23 user nova-compute[75258]:     <vmcoreinfo state='on'/>
Nov 14 12:39:23 user nova-compute[75258]:   </features>
Nov 14 12:39:23 user nova-compute[75258]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 12:39:23 user nova-compute[75258]:     <model fallback='forbid'>Nehalem</model>
Nov 14 12:39:23 user nova-compute[75258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 12:39:23 user nova-compute[75258]:     <feature policy='require' name='vme'/>
Nov 14 12:39:23 user nova-compute[75258]:     <feature policy='require' name='x2apic'/>
Nov 14 12:39:23 user nova-compute[75258]:     <feature policy='require' name='hypervisor'/>
Nov 14 12:39:23 user nova-compute[75258]:   </cpu>
Nov 14 12:39:23 user nova-compute[75258]:   <clock offset='utc'>
Nov 14 12:39:23 user nova-compute[75258]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 12:39:23 user nova-compute[75258]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 12:39:23 user nova-compute[75258]:     <timer name='hpet' present='no'/>
Nov 14 12:39:23 user nova-compute[75258]:   </clock>
Nov 14 12:39:23 user nova-compute[75258]:   <on_poweroff>destroy</on_poweroff>
Nov 14 12:39:23 user nova-compute[75258]:   <on_reboot>restart</on_reboot>
Nov 14 12:39:23 user nova-compute[75258]:   <on_crash>destroy</on_crash>
Nov 14 12:39:23 user nova-compute[75258]:   <devices>
Nov 14 12:39:23 user nova-compute[75258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 12:39:23 user nova-compute[75258]:     <disk type='file' device='disk'>
Nov 14 12:39:23 user nova-compute[75258]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 12:39:23 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk' index='2'/>
Nov 14 12:39:23 user nova-compute[75258]:       <backingStore type='file' index='3'>
Nov 14 12:39:23 user nova-compute[75258]:         <format type='raw'/>
Nov 14 12:39:23 user nova-compute[75258]:         <source file='/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae'/>
Nov 14 12:39:23 user nova-compute[75258]:         <backingStore/>
Nov 14 12:39:23 user nova-compute[75258]:       </backingStore>
Nov 14 12:39:23 user nova-compute[75258]:       <target dev='vda' bus='virtio'/>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='virtio-disk0'/>
Nov 14 12:39:23 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </disk>
Nov 14 12:39:23 user nova-compute[75258]:     <disk type='file' device='cdrom'>
Nov 14 12:39:23 user nova-compute[75258]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 12:39:23 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config' index='1'/>
Nov 14 12:39:23 user nova-compute[75258]:       <backingStore/>
Nov 14 12:39:23 user nova-compute[75258]:       <target dev='hda' bus='ide'/>
Nov 14 12:39:23 user nova-compute[75258]:       <readonly/>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='ide0-0-0'/>
Nov 14 12:39:23 user nova-compute[75258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </disk>
Nov 14 12:39:23 user nova-compute[75258]:     <controller type='usb' index='0' model='none'>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='usb'/>
Nov 14 12:39:23 user nova-compute[75258]:     </controller>
Nov 14 12:39:23 user nova-compute[75258]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='pci.0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </controller>
Nov 14 12:39:23 user nova-compute[75258]:     <controller type='ide' index='0'>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='ide'/>
Nov 14 12:39:23 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 12:39:23 user nova-compute[75258]:     </controller>
Nov 14 12:39:23 user nova-compute[75258]:     <interface type='ethernet'>
Nov 14 12:39:23 user nova-compute[75258]:       <mac address='fa:16:3e:de:48:6b'/>
Nov 14 12:39:23 user nova-compute[75258]:       <target dev='tap84f9ac77-62'/>
Nov 14 12:39:23 user nova-compute[75258]:       <model type='virtio'/>
Nov 14 12:39:23 user nova-compute[75258]:       <mtu size='1442'/>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='net0'/>
Nov 14 12:39:23 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </interface>
Nov 14 12:39:23 user nova-compute[75258]:     <serial type='pty'>
Nov 14 12:39:23 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:23 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:23 user nova-compute[75258]:       <target type='isa-serial' port='0'>
Nov 14 12:39:23 user nova-compute[75258]:         <model name='isa-serial'/>
Nov 14 12:39:23 user nova-compute[75258]:       </target>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </serial>
Nov 14 12:39:23 user nova-compute[75258]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 12:39:23 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:23 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:23 user nova-compute[75258]:       <target type='serial' port='0'/>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </console>
Nov 14 12:39:23 user nova-compute[75258]:     <input type='mouse' bus='ps2'>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='input0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </input>
Nov 14 12:39:23 user nova-compute[75258]:     <input type='keyboard' bus='ps2'>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='input1'/>
Nov 14 12:39:23 user nova-compute[75258]:     </input>
Nov 14 12:39:23 user nova-compute[75258]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 12:39:23 user nova-compute[75258]:       <listen type='address' address='0.0.0.0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </graphics>
Nov 14 12:39:23 user nova-compute[75258]:     <audio id='1' type='none'/>
Nov 14 12:39:23 user nova-compute[75258]:     <video>
Nov 14 12:39:23 user nova-compute[75258]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='video0'/>
Nov 14 12:39:23 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </video>
Nov 14 12:39:23 user nova-compute[75258]:     <memballoon model='virtio'>
Nov 14 12:39:23 user nova-compute[75258]:       <stats period='10'/>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='balloon0'/>
Nov 14 12:39:23 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:23 user nova-compute[75258]:     <rng model='virtio'>
Nov 14 12:39:23 user nova-compute[75258]:       <backend model='random'>/dev/urandom</backend>
Nov 14 12:39:23 user nova-compute[75258]:       <alias name='rng0'/>
Nov 14 12:39:23 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 12:39:23 user nova-compute[75258]:     </rng>
Nov 14 12:39:23 user nova-compute[75258]:   </devices>
Nov 14 12:39:23 user nova-compute[75258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 12:39:23 user nova-compute[75258]:     <label>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</label>
Nov 14 12:39:23 user nova-compute[75258]:     <imagelabel>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</imagelabel>
Nov 14 12:39:23 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:23 user nova-compute[75258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 12:39:23 user nova-compute[75258]:     <label>+64055:+108</label>
Nov 14 12:39:23 user nova-compute[75258]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 12:39:23 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:23 user nova-compute[75258]: </domain>
Nov 14 12:39:23 user nova-compute[75258]:  {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 12:39:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully detached device tap25ecabbe-69 from instance fda05899-30ea-43b3-9191-f0a4a5bbba4d from the live domain config.
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converting VIF {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_vif [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1141644014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1141644014',id=13,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-vrhvg0r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:09Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=5cc80485-d82a-4cf9-856c-6594f6e37c7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25ecabbe-69, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0ce15b34-571e-462d-8c72-5b6a740137eb) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:39:23 user nova-compute[75258]:   <uuid>5cc80485-d82a-4cf9-856c-6594f6e37c7e</uuid>
Nov 14 12:39:23 user nova-compute[75258]:   <name>instance-0000000d</name>
Nov 14 12:39:23 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:39:23 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:39:23 user nova-compute[75258]:   <metadata>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:23 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:39:23 user nova-compute[75258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1141644014</nova:name>
Nov 14 12:39:23 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:39:21</nova:creationTime>
Nov 14 12:39:23 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:39:23 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:39:23 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:39:23 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:39:23 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:23 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:23 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:39:23 user nova-compute[75258]:       <nova:owner>
Nov 14 12:39:23 user nova-compute[75258]:         <nova:user uuid="cef85161135e4a978dd763ae91809be9">tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member</nova:user>
Nov 14 12:39:23 user nova-compute[75258]:         <nova:project uuid="c593ba588c7f442689362cda037f95f8">tempest-ServerBootFromVolumeStableRescueTest-1735756414</nova:project>
Nov 14 12:39:23 user nova-compute[75258]:       </nova:owner>
Nov 14 12:39:23 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:23 user nova-compute[75258]:       <nova:ports>
Nov 14 12:39:23 user nova-compute[75258]:         <nova:port uuid="12b52550-1a48-42c6-bd83-4241dd9e7e4e">
Nov 14 12:39:23 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:39:23 user nova-compute[75258]:         </nova:port>
Nov 14 12:39:23 user nova-compute[75258]:       </nova:ports>
Nov 14 12:39:23 user nova-compute[75258]:     </nova:instance>
Nov 14 12:39:23 user nova-compute[75258]:   </metadata>
Nov 14 12:39:23 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:39:23 user nova-compute[75258]:     <system>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name="serial">5cc80485-d82a-4cf9-856c-6594f6e37c7e</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name="uuid">5cc80485-d82a-4cf9-856c-6594f6e37c7e</entry>
Nov 14 12:39:23 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:39:23 user nova-compute[75258]:     </system>
Nov 14 12:39:23 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:23 user nova-compute[75258]:   <os>
Nov 14 12:39:23 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:39:23 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:39:23 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:39:23 user nova-compute[75258]:   </os>
Nov 14 12:39:23 user nova-compute[75258]:   <features>
Nov 14 12:39:23 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:23 user nova-compute[75258]:     <apic/>
Nov 14 12:39:23 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:39:23 user nova-compute[75258]:   </features>
Nov 14 12:39:23 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:39:23 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:39:23 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:39:23 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:39:23 user nova-compute[75258]:   </clock>
Nov 14 12:39:23 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:39:23 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:39:23 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:39:23 user nova-compute[75258]:   </cpu>
Nov 14 12:39:23 user nova-compute[75258]:   <devices>
Nov 14 12:39:23 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:39:23 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:23 user nova-compute[75258]:       <source dev="/dev/sdc"/>
Nov 14 12:39:23 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:39:23 user nova-compute[75258]:       <serial>f6846ab5-9d42-4ade-baa2-ed961c7c0132</serial>
Nov 14 12:39:23 user nova-compute[75258]:     </disk>
Nov 14 12:39:23 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:39:23 user nova-compute[75258]:       <mac address="fa:16:3e:f4:71:6f"/>
Nov 14 12:39:23 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:23 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:39:23 user nova-compute[75258]:       <target dev="tap12b52550-1a"/>
Nov 14 12:39:23 user nova-compute[75258]:     </interface>
Nov 14 12:39:23 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:39:23 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/console.log" append="off"/>
Nov 14 12:39:23 user nova-compute[75258]:     </serial>
Nov 14 12:39:23 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:39:23 user nova-compute[75258]:     <video>
Nov 14 12:39:23 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:23 user nova-compute[75258]:     </video>
Nov 14 12:39:23 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:39:23 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:39:23 user nova-compute[75258]:     </rng>
Nov 14 12:39:23 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:39:23 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:39:23 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:39:23 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:23 user nova-compute[75258]:   </devices>
Nov 14 12:39:23 user nova-compute[75258]: </domain>
Nov 14 12:39:23 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1141644014',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1141644014',id=13,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-vrhvg0r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:09Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=5cc80485-d82a-4cf9-856c-6594f6e37c7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_vif [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e0b2b99f-21bb-568e-800a-6024a875999a', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:23 user nova-compute[75258]: INFO os_vif [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69')
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:23 user nova-compute[75258]:   <nova:package version="0.0.0"/>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:creationTime>2023-11-14 12:39:23</nova:creationTime>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:flavor name="m1.tiny">
Nov 14 12:39:23 user nova-compute[75258]:     <nova:memory>512</nova:memory>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:disk>1</nova:disk>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:swap>0</nova:swap>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:23 user nova-compute[75258]:   </nova:flavor>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:owner>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:39:23 user nova-compute[75258]:   </nova:owner>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:23 user nova-compute[75258]:   <nova:ports>
Nov 14 12:39:23 user nova-compute[75258]:     <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:39:23 user nova-compute[75258]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:39:23 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:23 user nova-compute[75258]:   </nova:ports>
Nov 14 12:39:23 user nova-compute[75258]: </nova:instance>
Nov 14 12:39:23 user nova-compute[75258]:  {{(pid=75258) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap12b52550-1a, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap12b52550-1a, col_values=(('qos', UUID('83f64912-a391-4172-8448-004720aafda9')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap12b52550-1a, col_values=(('external_ids', {'iface-id': '12b52550-1a48-42c6-bd83-4241dd9e7e4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f4:71:6f', 'vm-uuid': '5cc80485-d82a-4cf9-856c-6594f6e37c7e'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: INFO os_vif [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a')
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No VIF found with MAC fa:16:3e:f4:71:6f, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-deleted-25ecabbe-697f-4a21-b558-f3d67d0bcf47 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:23 user nova-compute[75258]: INFO nova.compute.manager [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Neutron deleted interface 25ecabbe-697f-4a21-b558-f3d67d0bcf47; detaching it from the instance and deleting it from the info cache
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.neutron [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qloNbwjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:23 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:23 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:23 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.objects.instance [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Lazy-loading 'system_metadata' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquired lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7f47a3-105c-4ce9-88a3-baeadacefe95]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:39:23 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[914f7b70-a06d-438e-bde9-03c2303dbd63]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474] added
Nov 14 12:39:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:23 user nova-compute[75258]: DEBUG nova.objects.instance [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Lazy-loading 'flavor' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e48fe0-e430-4cc9-9da9-65bcf3229eeb]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f24c9e9-c72a-496f-887c-e446efb6a30a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qloNbwjD {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.objects.base [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Object Instance<fda05899-30ea-43b3-9191-f0a4a5bbba4d> lazy-loaded attributes: system_metadata,flavor {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.network.os_vif_util [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Converting VIF {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.network.os_vif_util [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qloNbwjD" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4da8eaa2-4e06-4a93-bcb3-6d0c0d09fcb1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qloNbwjD'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface> {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 12:39:24 user nova-compute[75258]:   <name>instance-00000007</name>
Nov 14 12:39:24 user nova-compute[75258]:   <uuid>fda05899-30ea-43b3-9191-f0a4a5bbba4d</uuid>
Nov 14 12:39:24 user nova-compute[75258]:   <metadata>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:24 user nova-compute[75258]:   <nova:package version="0.0.0"/>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:creationTime>2023-11-14 12:39:23</nova:creationTime>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:flavor name="m1.tiny">
Nov 14 12:39:24 user nova-compute[75258]:     <nova:memory>512</nova:memory>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:disk>1</nova:disk>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:swap>0</nova:swap>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:flavor>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:owner>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:owner>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:ports>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:39:24 user nova-compute[75258]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:39:24 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:ports>
Nov 14 12:39:24 user nova-compute[75258]: </nova:instance>
Nov 14 12:39:24 user nova-compute[75258]:   </metadata>
Nov 14 12:39:24 user nova-compute[75258]:   <memory unit='KiB'>524288</memory>
Nov 14 12:39:24 user nova-compute[75258]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 12:39:24 user nova-compute[75258]:   <vcpu placement='static'>1</vcpu>
Nov 14 12:39:24 user nova-compute[75258]:   <resource>
Nov 14 12:39:24 user nova-compute[75258]:     <partition>/machine</partition>
Nov 14 12:39:24 user nova-compute[75258]:   </resource>
Nov 14 12:39:24 user nova-compute[75258]:   <sysinfo type='smbios'>
Nov 14 12:39:24 user nova-compute[75258]:     <system>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='version'>0.0.0</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='serial'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='uuid'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='family'>Virtual Machine</entry>
Nov 14 12:39:24 user nova-compute[75258]:     </system>
Nov 14 12:39:24 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:24 user nova-compute[75258]:   <os>
Nov 14 12:39:24 user nova-compute[75258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 12:39:24 user nova-compute[75258]:     <boot dev='hd'/>
Nov 14 12:39:24 user nova-compute[75258]:     <smbios mode='sysinfo'/>
Nov 14 12:39:24 user nova-compute[75258]:   </os>
Nov 14 12:39:24 user nova-compute[75258]:   <features>
Nov 14 12:39:24 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:24 user nova-compute[75258]:     <apic/>
Nov 14 12:39:24 user nova-compute[75258]:     <vmcoreinfo state='on'/>
Nov 14 12:39:24 user nova-compute[75258]:   </features>
Nov 14 12:39:24 user nova-compute[75258]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 12:39:24 user nova-compute[75258]:     <model fallback='forbid'>Nehalem</model>
Nov 14 12:39:24 user nova-compute[75258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 12:39:24 user nova-compute[75258]:     <feature policy='require' name='vme'/>
Nov 14 12:39:24 user nova-compute[75258]:     <feature policy='require' name='x2apic'/>
Nov 14 12:39:24 user nova-compute[75258]:     <feature policy='require' name='hypervisor'/>
Nov 14 12:39:24 user nova-compute[75258]:   </cpu>
Nov 14 12:39:24 user nova-compute[75258]:   <clock offset='utc'>
Nov 14 12:39:24 user nova-compute[75258]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 12:39:24 user nova-compute[75258]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 12:39:24 user nova-compute[75258]:     <timer name='hpet' present='no'/>
Nov 14 12:39:24 user nova-compute[75258]:   </clock>
Nov 14 12:39:24 user nova-compute[75258]:   <on_poweroff>destroy</on_poweroff>
Nov 14 12:39:24 user nova-compute[75258]:   <on_reboot>restart</on_reboot>
Nov 14 12:39:24 user nova-compute[75258]:   <on_crash>destroy</on_crash>
Nov 14 12:39:24 user nova-compute[75258]:   <devices>
Nov 14 12:39:24 user nova-compute[75258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 12:39:24 user nova-compute[75258]:     <disk type='file' device='disk'>
Nov 14 12:39:24 user nova-compute[75258]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 12:39:24 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk' index='2'/>
Nov 14 12:39:24 user nova-compute[75258]:       <backingStore type='file' index='3'>
Nov 14 12:39:24 user nova-compute[75258]:         <format type='raw'/>
Nov 14 12:39:24 user nova-compute[75258]:         <source file='/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae'/>
Nov 14 12:39:24 user nova-compute[75258]:         <backingStore/>
Nov 14 12:39:24 user nova-compute[75258]:       </backingStore>
Nov 14 12:39:24 user nova-compute[75258]:       <target dev='vda' bus='virtio'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='virtio-disk0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </disk>
Nov 14 12:39:24 user nova-compute[75258]:     <disk type='file' device='cdrom'>
Nov 14 12:39:24 user nova-compute[75258]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 12:39:24 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config' index='1'/>
Nov 14 12:39:24 user nova-compute[75258]:       <backingStore/>
Nov 14 12:39:24 user nova-compute[75258]:       <target dev='hda' bus='ide'/>
Nov 14 12:39:24 user nova-compute[75258]:       <readonly/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='ide0-0-0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </disk>
Nov 14 12:39:24 user nova-compute[75258]:     <controller type='usb' index='0' model='none'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='usb'/>
Nov 14 12:39:24 user nova-compute[75258]:     </controller>
Nov 14 12:39:24 user nova-compute[75258]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='pci.0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </controller>
Nov 14 12:39:24 user nova-compute[75258]:     <controller type='ide' index='0'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='ide'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 12:39:24 user nova-compute[75258]:     </controller>
Nov 14 12:39:24 user nova-compute[75258]:     <interface type='ethernet'>
Nov 14 12:39:24 user nova-compute[75258]:       <mac address='fa:16:3e:de:48:6b'/>
Nov 14 12:39:24 user nova-compute[75258]:       <target dev='tap84f9ac77-62'/>
Nov 14 12:39:24 user nova-compute[75258]:       <model type='virtio'/>
Nov 14 12:39:24 user nova-compute[75258]:       <mtu size='1442'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='net0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </interface>
Nov 14 12:39:24 user nova-compute[75258]:     <serial type='pty'>
Nov 14 12:39:24 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:24 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:24 user nova-compute[75258]:       <target type='isa-serial' port='0'>
Nov 14 12:39:24 user nova-compute[75258]:         <model name='isa-serial'/>
Nov 14 12:39:24 user nova-compute[75258]:       </target>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </serial>
Nov 14 12:39:24 user nova-compute[75258]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 12:39:24 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:24 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:24 user nova-compute[75258]:       <target type='serial' port='0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </console>
Nov 14 12:39:24 user nova-compute[75258]:     <input type='mouse' bus='ps2'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='input0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </input>
Nov 14 12:39:24 user nova-compute[75258]:     <input type='keyboard' bus='ps2'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='input1'/>
Nov 14 12:39:24 user nova-compute[75258]:     </input>
Nov 14 12:39:24 user nova-compute[75258]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 12:39:24 user nova-compute[75258]:       <listen type='address' address='0.0.0.0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </graphics>
Nov 14 12:39:24 user nova-compute[75258]:     <audio id='1' type='none'/>
Nov 14 12:39:24 user nova-compute[75258]:     <video>
Nov 14 12:39:24 user nova-compute[75258]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='video0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </video>
Nov 14 12:39:24 user nova-compute[75258]:     <memballoon model='virtio'>
Nov 14 12:39:24 user nova-compute[75258]:       <stats period='10'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='balloon0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:24 user nova-compute[75258]:     <rng model='virtio'>
Nov 14 12:39:24 user nova-compute[75258]:       <backend model='random'>/dev/urandom</backend>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='rng0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </rng>
Nov 14 12:39:24 user nova-compute[75258]:   </devices>
Nov 14 12:39:24 user nova-compute[75258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 12:39:24 user nova-compute[75258]:     <label>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</label>
Nov 14 12:39:24 user nova-compute[75258]:     <imagelabel>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</imagelabel>
Nov 14 12:39:24 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:24 user nova-compute[75258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 12:39:24 user nova-compute[75258]:     <label>+64055:+108</label>
Nov 14 12:39:24 user nova-compute[75258]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 12:39:24 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:24 user nova-compute[75258]: </domain>
Nov 14 12:39:24 user nova-compute[75258]:  {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface> {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d806d46-06b9-4185-8061-330e9fb8280b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] interface for config: <interface type="ethernet"><mac address="fa:16:3e:26:a2:69"/><model type="virtio"/><mtu size="1442"/><target dev="tap25ecabbe-69"/></interface>not found in domain: <domain type='kvm' id='7'>
Nov 14 12:39:24 user nova-compute[75258]:   <name>instance-00000007</name>
Nov 14 12:39:24 user nova-compute[75258]:   <uuid>fda05899-30ea-43b3-9191-f0a4a5bbba4d</uuid>
Nov 14 12:39:24 user nova-compute[75258]:   <metadata>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:24 user nova-compute[75258]:   <nova:package version="0.0.0"/>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:creationTime>2023-11-14 12:39:23</nova:creationTime>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:flavor name="m1.tiny">
Nov 14 12:39:24 user nova-compute[75258]:     <nova:memory>512</nova:memory>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:disk>1</nova:disk>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:swap>0</nova:swap>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:flavor>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:owner>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:owner>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:ports>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:39:24 user nova-compute[75258]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:39:24 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:ports>
Nov 14 12:39:24 user nova-compute[75258]: </nova:instance>
Nov 14 12:39:24 user nova-compute[75258]:   </metadata>
Nov 14 12:39:24 user nova-compute[75258]:   <memory unit='KiB'>524288</memory>
Nov 14 12:39:24 user nova-compute[75258]:   <currentMemory unit='KiB'>524288</currentMemory>
Nov 14 12:39:24 user nova-compute[75258]:   <vcpu placement='static'>1</vcpu>
Nov 14 12:39:24 user nova-compute[75258]:   <resource>
Nov 14 12:39:24 user nova-compute[75258]:     <partition>/machine</partition>
Nov 14 12:39:24 user nova-compute[75258]:   </resource>
Nov 14 12:39:24 user nova-compute[75258]:   <sysinfo type='smbios'>
Nov 14 12:39:24 user nova-compute[75258]:     <system>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='product'>OpenStack Nova</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='version'>0.0.0</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='serial'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='uuid'>fda05899-30ea-43b3-9191-f0a4a5bbba4d</entry>
Nov 14 12:39:24 user nova-compute[75258]:       <entry name='family'>Virtual Machine</entry>
Nov 14 12:39:24 user nova-compute[75258]:     </system>
Nov 14 12:39:24 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:24 user nova-compute[75258]:   <os>
Nov 14 12:39:24 user nova-compute[75258]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Nov 14 12:39:24 user nova-compute[75258]:     <boot dev='hd'/>
Nov 14 12:39:24 user nova-compute[75258]:     <smbios mode='sysinfo'/>
Nov 14 12:39:24 user nova-compute[75258]:   </os>
Nov 14 12:39:24 user nova-compute[75258]:   <features>
Nov 14 12:39:24 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:24 user nova-compute[75258]:     <apic/>
Nov 14 12:39:24 user nova-compute[75258]:     <vmcoreinfo state='on'/>
Nov 14 12:39:24 user nova-compute[75258]:   </features>
Nov 14 12:39:24 user nova-compute[75258]:   <cpu mode='custom' match='exact' check='full'>
Nov 14 12:39:24 user nova-compute[75258]:     <model fallback='forbid'>Nehalem</model>
Nov 14 12:39:24 user nova-compute[75258]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Nov 14 12:39:24 user nova-compute[75258]:     <feature policy='require' name='vme'/>
Nov 14 12:39:24 user nova-compute[75258]:     <feature policy='require' name='x2apic'/>
Nov 14 12:39:24 user nova-compute[75258]:     <feature policy='require' name='hypervisor'/>
Nov 14 12:39:24 user nova-compute[75258]:   </cpu>
Nov 14 12:39:24 user nova-compute[75258]:   <clock offset='utc'>
Nov 14 12:39:24 user nova-compute[75258]:     <timer name='pit' tickpolicy='delay'/>
Nov 14 12:39:24 user nova-compute[75258]:     <timer name='rtc' tickpolicy='catchup'/>
Nov 14 12:39:24 user nova-compute[75258]:     <timer name='hpet' present='no'/>
Nov 14 12:39:24 user nova-compute[75258]:   </clock>
Nov 14 12:39:24 user nova-compute[75258]:   <on_poweroff>destroy</on_poweroff>
Nov 14 12:39:24 user nova-compute[75258]:   <on_reboot>restart</on_reboot>
Nov 14 12:39:24 user nova-compute[75258]:   <on_crash>destroy</on_crash>
Nov 14 12:39:24 user nova-compute[75258]:   <devices>
Nov 14 12:39:24 user nova-compute[75258]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Nov 14 12:39:24 user nova-compute[75258]:     <disk type='file' device='disk'>
Nov 14 12:39:24 user nova-compute[75258]:       <driver name='qemu' type='qcow2' cache='none'/>
Nov 14 12:39:24 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk' index='2'/>
Nov 14 12:39:24 user nova-compute[75258]:       <backingStore type='file' index='3'>
Nov 14 12:39:24 user nova-compute[75258]:         <format type='raw'/>
Nov 14 12:39:24 user nova-compute[75258]:         <source file='/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae'/>
Nov 14 12:39:24 user nova-compute[75258]:         <backingStore/>
Nov 14 12:39:24 user nova-compute[75258]:       </backingStore>
Nov 14 12:39:24 user nova-compute[75258]:       <target dev='vda' bus='virtio'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='virtio-disk0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </disk>
Nov 14 12:39:24 user nova-compute[75258]:     <disk type='file' device='cdrom'>
Nov 14 12:39:24 user nova-compute[75258]:       <driver name='qemu' type='raw' cache='none'/>
Nov 14 12:39:24 user nova-compute[75258]:       <source file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/disk.config' index='1'/>
Nov 14 12:39:24 user nova-compute[75258]:       <backingStore/>
Nov 14 12:39:24 user nova-compute[75258]:       <target dev='hda' bus='ide'/>
Nov 14 12:39:24 user nova-compute[75258]:       <readonly/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='ide0-0-0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </disk>
Nov 14 12:39:24 user nova-compute[75258]:     <controller type='usb' index='0' model='none'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='usb'/>
Nov 14 12:39:24 user nova-compute[75258]:     </controller>
Nov 14 12:39:24 user nova-compute[75258]:     <controller type='pci' index='0' model='pci-root'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='pci.0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </controller>
Nov 14 12:39:24 user nova-compute[75258]:     <controller type='ide' index='0'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='ide'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Nov 14 12:39:24 user nova-compute[75258]:     </controller>
Nov 14 12:39:24 user nova-compute[75258]:     <interface type='ethernet'>
Nov 14 12:39:24 user nova-compute[75258]:       <mac address='fa:16:3e:de:48:6b'/>
Nov 14 12:39:24 user nova-compute[75258]:       <target dev='tap84f9ac77-62'/>
Nov 14 12:39:24 user nova-compute[75258]:       <model type='virtio'/>
Nov 14 12:39:24 user nova-compute[75258]:       <mtu size='1442'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='net0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </interface>
Nov 14 12:39:24 user nova-compute[75258]:     <serial type='pty'>
Nov 14 12:39:24 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:24 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:24 user nova-compute[75258]:       <target type='isa-serial' port='0'>
Nov 14 12:39:24 user nova-compute[75258]:         <model name='isa-serial'/>
Nov 14 12:39:24 user nova-compute[75258]:       </target>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </serial>
Nov 14 12:39:24 user nova-compute[75258]:     <console type='pty' tty='/dev/pts/6'>
Nov 14 12:39:24 user nova-compute[75258]:       <source path='/dev/pts/6'/>
Nov 14 12:39:24 user nova-compute[75258]:       <log file='/opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d/console.log' append='off'/>
Nov 14 12:39:24 user nova-compute[75258]:       <target type='serial' port='0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='serial0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </console>
Nov 14 12:39:24 user nova-compute[75258]:     <input type='mouse' bus='ps2'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='input0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </input>
Nov 14 12:39:24 user nova-compute[75258]:     <input type='keyboard' bus='ps2'>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='input1'/>
Nov 14 12:39:24 user nova-compute[75258]:     </input>
Nov 14 12:39:24 user nova-compute[75258]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Nov 14 12:39:24 user nova-compute[75258]:       <listen type='address' address='0.0.0.0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </graphics>
Nov 14 12:39:24 user nova-compute[75258]:     <audio id='1' type='none'/>
Nov 14 12:39:24 user nova-compute[75258]:     <video>
Nov 14 12:39:24 user nova-compute[75258]:       <model type='virtio' heads='1' primary='yes'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='video0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </video>
Nov 14 12:39:24 user nova-compute[75258]:     <memballoon model='virtio'>
Nov 14 12:39:24 user nova-compute[75258]:       <stats period='10'/>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='balloon0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:24 user nova-compute[75258]:     <rng model='virtio'>
Nov 14 12:39:24 user nova-compute[75258]:       <backend model='random'>/dev/urandom</backend>
Nov 14 12:39:24 user nova-compute[75258]:       <alias name='rng0'/>
Nov 14 12:39:24 user nova-compute[75258]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Nov 14 12:39:24 user nova-compute[75258]:     </rng>
Nov 14 12:39:24 user nova-compute[75258]:   </devices>
Nov 14 12:39:24 user nova-compute[75258]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Nov 14 12:39:24 user nova-compute[75258]:     <label>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</label>
Nov 14 12:39:24 user nova-compute[75258]:     <imagelabel>libvirt-fda05899-30ea-43b3-9191-f0a4a5bbba4d</imagelabel>
Nov 14 12:39:24 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:24 user nova-compute[75258]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Nov 14 12:39:24 user nova-compute[75258]:     <label>+64055:+108</label>
Nov 14 12:39:24 user nova-compute[75258]:     <imagelabel>+64055:+108</imagelabel>
Nov 14 12:39:24 user nova-compute[75258]:   </seclabel>
Nov 14 12:39:24 user nova-compute[75258]: </domain>
Nov 14 12:39:24 user nova-compute[75258]:  {{(pid=75258) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Nov 14 12:39:24 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Detaching interface fa:16:3e:26:a2:69 failed because the device is no longer found on the guest.: nova.exception.DeviceNotFound: Device 'tap25ecabbe-69' not found.
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata=<?>,migration_context=None,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.network.os_vif_util [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Converting VIF {"id": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "address": "fa:16:3e:26:a2:69", "network": {"id": "b2bf83c4-10e0-4d80-8783-e82962147059", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-1476033598", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.197", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25ecabbe-69", "ovs_interfaceid": "25ecabbe-697f-4a21-b558-f3d67d0bcf47", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.network.os_vif_util [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_vif [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a6ad64d-ee60-48a1-9804-126c20dd8f25]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25ecabbe-69, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: INFO os_vif [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:26:a2:69,bridge_name='br-int',has_traffic_filtering=True,id=25ecabbe-697f-4a21-b558-f3d67d0bcf47,network=Network(b2bf83c4-10e0-4d80-8783-e82962147059),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25ecabbe-69')
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [req-c95c0974-818d-4f52-9b15-ad0652678fc4 req-62e7316c-3472-445b-8ecf-df2fd6261a50 service nova] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:24 user nova-compute[75258]:   <nova:package version="0.0.0"/>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:name>tempest-device-tagging-server-1936237301</nova:name>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:creationTime>2023-11-14 12:39:24</nova:creationTime>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:flavor name="m1.tiny">
Nov 14 12:39:24 user nova-compute[75258]:     <nova:memory>512</nova:memory>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:disk>1</nova:disk>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:swap>0</nova:swap>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:flavor>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:owner>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:user uuid="d09eb01d5c6741b4ac32283284df01ff">tempest-TaggedAttachmentsTest-991165541-project-member</nova:user>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:project uuid="c4b829e058e44d7cb8eeb158f2b6ea72">tempest-TaggedAttachmentsTest-991165541</nova:project>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:owner>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:24 user nova-compute[75258]:   <nova:ports>
Nov 14 12:39:24 user nova-compute[75258]:     <nova:port uuid="84f9ac77-622e-413e-9490-b2be292eee05">
Nov 14 12:39:24 user nova-compute[75258]:       <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:39:24 user nova-compute[75258]:     </nova:port>
Nov 14 12:39:24 user nova-compute[75258]:   </nova:ports>
Nov 14 12:39:24 user nova-compute[75258]: </nova:instance>
Nov 14 12:39:24 user nova-compute[75258]:  {{(pid=75258) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --login" returned: 0 in 0.086s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c80e814-d6e6-4278-9fe5-c60a80aa4e36]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260]
Nov 14 12:39:24 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.035s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[40fe58b0-b6d0-4acc-b4fd-04540ca1a7e8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d951adf-700e-43b1-a0ee-bba0ec7c7c9f]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:24 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.404s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] HCTL ('35', '-', '-', 0) found on session 13 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[31006c67-c2c1-478c-96a3-c936dd9f6948]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Searching for a device in session 13 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qloNbwjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [{"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Releasing lock "refresh_cache-fda05899-30ea-43b3-9191-f0a4a5bbba4d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0cb6dc61-b70c-4bd0-944c-8f096158e33e tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "interface-fda05899-30ea-43b3-9191-f0a4a5bbba4d-25ecabbe-697f-4a21-b558-f3d67d0bcf47" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 21.625s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-06e39de1-6643-4b53-a6ec-91cab1598021 req-b784bcd9-24f4-4e8e-acfb-3578d4a58688 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received event network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06e39de1-6643-4b53-a6ec-91cab1598021 req-b784bcd9-24f4-4e8e-acfb-3578d4a58688 service nova] Acquiring lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06e39de1-6643-4b53-a6ec-91cab1598021 req-b784bcd9-24f4-4e8e-acfb-3578d4a58688 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06e39de1-6643-4b53-a6ec-91cab1598021 req-b784bcd9-24f4-4e8e-acfb-3578d4a58688 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-06e39de1-6643-4b53-a6ec-91cab1598021 req-b784bcd9-24f4-4e8e-acfb-3578d4a58688 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] No waiting events found dispatching network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:24 user nova-compute[75258]: WARNING nova.compute.manager [req-06e39de1-6643-4b53-a6ec-91cab1598021 req-b784bcd9-24f4-4e8e-acfb-3578d4a58688 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received unexpected event network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe for instance with vm_state building and task_state spawning.
Nov 14 12:39:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:39:25 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Instance spawned successfully.
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:25 user nova-compute[75258]: INFO nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Took 5.92 seconds to spawn the instance on the hypervisor.
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.439s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== connect_volume: return (1440ms) {'type': 'block', 'scsi_wwn': '26132393632616238', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132393632616238', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'flavor' on Instance uuid 3c2491e0-6711-4e46-9290-a4e4ad834cab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:25 user nova-compute[75258]: INFO nova.compute.manager [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Took 6.80 seconds to build instance.
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:39:25 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:25 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:39:25 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:39:25 user nova-compute[75258]:   <serial>69053c46-fd0f-4f28-bdcf-49d9c018a474</serial>
Nov 14 12:39:25 user nova-compute[75258]: </disk>
Nov 14 12:39:25 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e8e3d492-aa61-44c8-8476-9ed61508665c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.907s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No VIF found with MAC fa:16:3e:d5:a4:6f, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:25 user nova-compute[75258]: WARNING nova.compute.manager [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state building and task_state spawning.
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:25 user nova-compute[75258]: WARNING nova.compute.manager [req-f496180e-0306-4513-a21d-62441429b824 req-8a132cf6-5a83-4c52-abac-a3f2e904c1f8 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state building and task_state spawning.
Nov 14 12:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c624d5ce-7290-48b9-8d01-28a9e0fc198c tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.523s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "50b47c33-9bbb-48f5-b695-11c2986a458a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:39:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:26 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:39:26 user nova-compute[75258]: INFO nova.compute.claims [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Claim successful on node user
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:39:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance spawned successfully.
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.547s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:39:27 user nova-compute[75258]: INFO nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Took 5.78 seconds to spawn the instance on the hypervisor.
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.network.neutron [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:39:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:39:27 user nova-compute[75258]: INFO nova.compute.manager [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Took 19.34 seconds to build instance.
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee5685aa-fba9-45af-8fd7-61d041102690 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.493s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:39:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Creating image(s)
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "/opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "/opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "/opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG nova.policy [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '504c8651c03d47f399cbdfe0755ff396', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66786a4505824b018e8f4c0e37141d31', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk 1073741824" returned: 0 in 0.060s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.212s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Checking if we can resize image /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Successfully created port: d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Cannot resize image /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Ensure instance console log exists: /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Successfully updated port: d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "refresh_cache-50b47c33-9bbb-48f5-b695-11c2986a458a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquired lock "refresh_cache-50b47c33-9bbb-48f5-b695-11c2986a458a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received event network-changed-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Refreshing instance network info cache due to event network-changed-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] Acquiring lock "refresh_cache-50b47c33-9bbb-48f5-b695-11c2986a458a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Updating instance_info_cache with network_info: [{"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Releasing lock "refresh_cache-50b47c33-9bbb-48f5-b695-11c2986a458a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Instance network_info: |[{"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] Acquired lock "refresh_cache-50b47c33-9bbb-48f5-b695-11c2986a458a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Refreshing network info cache for port d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Start _get_guest_xml network_info=[{"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:39:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-23199992',display_name='tempest-VolumesNegativeTest-instance-23199992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-23199992',id=16,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66786a4505824b018e8f4c0e37141d31',ramdisk_id='',reservation_id='r-n74tpyf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-244840624',owner_user_name='tempest-VolumesNegativeTest-244840624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:28Z,user_data=None,user_id='504c8651c03d47f399cbdfe0755ff396',uuid=50b47c33-9bbb-48f5-b695-11c2986a458a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Converting VIF {"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=d7cfdd8f-7746-4b0f-a2fb-126a26e73f22,network=Network(3969c1ba-fd91-42e5-8bad-52610bdb7bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cfdd8f-77') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.objects.instance [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lazy-loading 'pci_devices' on Instance uuid 50b47c33-9bbb-48f5-b695-11c2986a458a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:39:29 user nova-compute[75258]:   <uuid>50b47c33-9bbb-48f5-b695-11c2986a458a</uuid>
Nov 14 12:39:29 user nova-compute[75258]:   <name>instance-00000010</name>
Nov 14 12:39:29 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:39:29 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:39:29 user nova-compute[75258]:   <metadata>
Nov 14 12:39:29 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:39:29 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:39:29 user nova-compute[75258]:       <nova:name>tempest-VolumesNegativeTest-instance-23199992</nova:name>
Nov 14 12:39:29 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:39:29</nova:creationTime>
Nov 14 12:39:29 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:39:29 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:39:29 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:39:29 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:39:29 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:39:29 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:39:29 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:39:29 user nova-compute[75258]:       <nova:owner>
Nov 14 12:39:29 user nova-compute[75258]:         <nova:user uuid="504c8651c03d47f399cbdfe0755ff396">tempest-VolumesNegativeTest-244840624-project-member</nova:user>
Nov 14 12:39:29 user nova-compute[75258]:         <nova:project uuid="66786a4505824b018e8f4c0e37141d31">tempest-VolumesNegativeTest-244840624</nova:project>
Nov 14 12:39:29 user nova-compute[75258]:       </nova:owner>
Nov 14 12:39:29 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:39:29 user nova-compute[75258]:       <nova:ports>
Nov 14 12:39:29 user nova-compute[75258]:         <nova:port uuid="d7cfdd8f-7746-4b0f-a2fb-126a26e73f22">
Nov 14 12:39:29 user nova-compute[75258]:           <nova:ip type="fixed" address="192.168.233.59" ipVersion="4"/>
Nov 14 12:39:29 user nova-compute[75258]:         </nova:port>
Nov 14 12:39:29 user nova-compute[75258]:       </nova:ports>
Nov 14 12:39:29 user nova-compute[75258]:     </nova:instance>
Nov 14 12:39:29 user nova-compute[75258]:   </metadata>
Nov 14 12:39:29 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:39:29 user nova-compute[75258]:     <system>
Nov 14 12:39:29 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:39:29 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:39:29 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:39:29 user nova-compute[75258]:       <entry name="serial">50b47c33-9bbb-48f5-b695-11c2986a458a</entry>
Nov 14 12:39:29 user nova-compute[75258]:       <entry name="uuid">50b47c33-9bbb-48f5-b695-11c2986a458a</entry>
Nov 14 12:39:29 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:39:29 user nova-compute[75258]:     </system>
Nov 14 12:39:29 user nova-compute[75258]:   </sysinfo>
Nov 14 12:39:29 user nova-compute[75258]:   <os>
Nov 14 12:39:29 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:39:29 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:39:29 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:39:29 user nova-compute[75258]:   </os>
Nov 14 12:39:29 user nova-compute[75258]:   <features>
Nov 14 12:39:29 user nova-compute[75258]:     <acpi/>
Nov 14 12:39:29 user nova-compute[75258]:     <apic/>
Nov 14 12:39:29 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:39:29 user nova-compute[75258]:   </features>
Nov 14 12:39:29 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:39:29 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:39:29 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:39:29 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:39:29 user nova-compute[75258]:   </clock>
Nov 14 12:39:29 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:39:29 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:39:29 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:39:29 user nova-compute[75258]:   </cpu>
Nov 14 12:39:29 user nova-compute[75258]:   <devices>
Nov 14 12:39:29 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:39:29 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:39:29 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk"/>
Nov 14 12:39:29 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:39:29 user nova-compute[75258]:     </disk>
Nov 14 12:39:29 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:39:29 user nova-compute[75258]:       <mac address="fa:16:3e:fc:7b:c9"/>
Nov 14 12:39:29 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:29 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:39:29 user nova-compute[75258]:       <target dev="tapd7cfdd8f-77"/>
Nov 14 12:39:29 user nova-compute[75258]:     </interface>
Nov 14 12:39:29 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:39:29 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/console.log" append="off"/>
Nov 14 12:39:29 user nova-compute[75258]:     </serial>
Nov 14 12:39:29 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:39:29 user nova-compute[75258]:     <video>
Nov 14 12:39:29 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:39:29 user nova-compute[75258]:     </video>
Nov 14 12:39:29 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:39:29 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:39:29 user nova-compute[75258]:     </rng>
Nov 14 12:39:29 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:39:29 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:39:29 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:39:29 user nova-compute[75258]:     </memballoon>
Nov 14 12:39:29 user nova-compute[75258]:   </devices>
Nov 14 12:39:29 user nova-compute[75258]: </domain>
Nov 14 12:39:29 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-23199992',display_name='tempest-VolumesNegativeTest-instance-23199992',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-23199992',id=16,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='66786a4505824b018e8f4c0e37141d31',ramdisk_id='',reservation_id='r-n74tpyf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-244840624',owner_user_name='tempest-VolumesNegativeTest-244840624-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:28Z,user_data=None,user_id='504c8651c03d47f399cbdfe0755ff396',uuid=50b47c33-9bbb-48f5-b695-11c2986a458a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Converting VIF {"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=d7cfdd8f-7746-4b0f-a2fb-126a26e73f22,network=Network(3969c1ba-fd91-42e5-8bad-52610bdb7bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cfdd8f-77') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG os_vif [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=d7cfdd8f-7746-4b0f-a2fb-126a26e73f22,network=Network(3969c1ba-fd91-42e5-8bad-52610bdb7bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cfdd8f-77') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e6a82f6e-15ad-579d-9083-c7b9fafaa295', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd7cfdd8f-77, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd7cfdd8f-77, col_values=(('qos', UUID('67b6ff85-c534-4636-b995-30af03d0c19b')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd7cfdd8f-77, col_values=(('external_ids', {'iface-id': 'd7cfdd8f-7746-4b0f-a2fb-126a26e73f22', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:7b:c9', 'vm-uuid': '50b47c33-9bbb-48f5-b695-11c2986a458a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:29 user nova-compute[75258]: INFO os_vif [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=d7cfdd8f-7746-4b0f-a2fb-126a26e73f22,network=Network(3969c1ba-fd91-42e5-8bad-52610bdb7bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cfdd8f-77')
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] No VIF found with MAC fa:16:3e:fc:7b:c9, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Updated VIF entry in instance network info cache for port d7cfdd8f-7746-4b0f-a2fb-126a26e73f22. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Updating instance_info_cache with network_info: [{"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-48487ef8-d8b4-436d-85af-74c0ff08ac63 req-2e58f662-4baa-4b09-a820-41bc7d78c18f service nova] Releasing lock "refresh_cache-50b47c33-9bbb-48f5-b695-11c2986a458a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:31 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 is timed out.
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:31 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config.
Nov 14 12:39:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ILYplyVZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:31 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e935489-cce3-44f5-8c1e-e17e73d3f79a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:39:31 user nova-compute[75258]: No targets found.
Nov 14 12:39:31 user nova-compute[75258]: iSNS:
Nov 14 12:39:31 user nova-compute[75258]: No targets found.
Nov 14 12:39:31 user nova-compute[75258]: STATIC:
Nov 14 12:39:31 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8
Nov 14 12:39:31 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:31 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:31 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:39:31 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:31 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:31 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474
Nov 14 12:39:31 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:31 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:31 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:39:31 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:31 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:31 user nova-compute[75258]: FIRMWARE:
Nov 14 12:39:31 user nova-compute[75258]: No targets found.
Nov 14 12:39:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:39:31 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:39:31 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d657d3-f8cb-45c7-a0df-f19ac7f462f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d208f9-41a7-4e7f-926c-9676de8201f8]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4ac110550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c6f1c2-ce86-4511-877a-570ba4d238a3]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aedcdb5-c257-4dc3-bc0e-f6cafd40c107]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8adc124e-0f13-4fe7-b836-6a634f3e2b6b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa42e5fe-b499-4943-8e17-f66cf0327cae]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-e4c18211-783f-45c4-9d8f-e4e602aa72d5 req-92729498-4a76-4501-8966-d7691d36500d service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received event network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e4c18211-783f-45c4-9d8f-e4e602aa72d5 req-92729498-4a76-4501-8966-d7691d36500d service nova] Acquiring lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e4c18211-783f-45c4-9d8f-e4e602aa72d5 req-92729498-4a76-4501-8966-d7691d36500d service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e4c18211-783f-45c4-9d8f-e4e602aa72d5 req-92729498-4a76-4501-8966-d7691d36500d service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-e4c18211-783f-45c4-9d8f-e4e602aa72d5 req-92729498-4a76-4501-8966-d7691d36500d service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] No waiting events found dispatching network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:31 user nova-compute[75258]: WARNING nova.compute.manager [req-e4c18211-783f-45c4-9d8f-e4e602aa72d5 req-92729498-4a76-4501-8966-d7691d36500d service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received unexpected event network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 for instance with vm_state building and task_state spawning.
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[336269c3-1216-4eca-b471-b75fab79db68]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2742cfd8-e8a5-4a07-b13f-ec929b366094]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260]
Nov 14 12:39:31 user nova-compute[75258]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:62bb2f7b-a6fc-43e1-a846-4aebdf04a7f8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[810e3ddb-10a8-4142-9eda-e95b9a5a7145]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.406s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== disconnect_volume: return (408ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:32 user nova-compute[75258]: DEBUG nova.objects.instance [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-95c1e88d-b412-49e9-82e3-c3b239732d26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.880s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:33 user nova-compute[75258]: INFO nova.compute.manager [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Detaching volume 69053c46-fd0f-4f28-bdcf-49d9c018a474
Nov 14 12:39:33 user nova-compute[75258]: INFO nova.virt.block_device [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Attempting to driver detach volume 69053c46-fd0f-4f28-bdcf-49d9c018a474 from mountpoint /dev/vdb
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Attempting to detach device vdb from instance 3c2491e0-6711-4e46-9290-a4e4ad834cab from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:39:33 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:33 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:39:33 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:39:33 user nova-compute[75258]:   <serial>69053c46-fd0f-4f28-bdcf-49d9c018a474</serial>
Nov 14 12:39:33 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:39:33 user nova-compute[75258]: </disk>
Nov 14 12:39:33 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:33 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully detached device vdb from instance 3c2491e0-6711-4e46-9290-a4e4ad834cab from the persistent domain config.
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3c2491e0-6711-4e46-9290-a4e4ad834cab from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:39:33 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:33 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:39:33 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:39:33 user nova-compute[75258]:   <serial>69053c46-fd0f-4f28-bdcf-49d9c018a474</serial>
Nov 14 12:39:33 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:39:33 user nova-compute[75258]: </disk>
Nov 14 12:39:33 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:39:33 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Instance spawned successfully.
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-a0c8bac4-a0ce-4b65-8a05-7c3f4cbe2ff1 req-531bddf5-3fd4-4e52-a9a3-5b7367d83aea service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received event network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a0c8bac4-a0ce-4b65-8a05-7c3f4cbe2ff1 req-531bddf5-3fd4-4e52-a9a3-5b7367d83aea service nova] Acquiring lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a0c8bac4-a0ce-4b65-8a05-7c3f4cbe2ff1 req-531bddf5-3fd4-4e52-a9a3-5b7367d83aea service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a0c8bac4-a0ce-4b65-8a05-7c3f4cbe2ff1 req-531bddf5-3fd4-4e52-a9a3-5b7367d83aea service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-a0c8bac4-a0ce-4b65-8a05-7c3f4cbe2ff1 req-531bddf5-3fd4-4e52-a9a3-5b7367d83aea service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] No waiting events found dispatching network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:33 user nova-compute[75258]: WARNING nova.compute.manager [req-a0c8bac4-a0ce-4b65-8a05-7c3f4cbe2ff1 req-531bddf5-3fd4-4e52-a9a3-5b7367d83aea service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received unexpected event network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 for instance with vm_state building and task_state spawning.
Nov 14 12:39:33 user nova-compute[75258]: INFO nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Took 6.01 seconds to spawn the instance on the hypervisor.
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:33 user nova-compute[75258]: INFO nova.compute.manager [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Took 6.99 seconds to build instance.
Nov 14 12:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-53040089-073f-4cdb-98b4-a2e7d5e4b4de tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.119s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3c2491e0-6711-4e46-9290-a4e4ad834cab {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:39:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-changed-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Refreshing instance network info cache due to event network-changed-789cac5f-ec82-4949-9568-e0064b11b92a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:39:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] Acquiring lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:39:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] Acquired lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:39:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Refreshing network info cache for port 789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updated VIF entry in instance network info cache for port 789cac5f-ec82-4949-9568-e0064b11b92a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updating instance_info_cache with network_info: [{"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1b945df1-4cc1-4881-adf6-1dbf50304a73 req-65945ddb-1304-47bc-b48d-9c46cf63574c service nova] Releasing lock "refresh_cache-4cd80282-24f6-4b44-bb13-f9586d478364" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'flavor' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:37 user nova-compute[75258]: INFO nova.compute.manager [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Attaching volume 432ad3bd-37ce-445a-9b4e-7ab1a40ce96b to /dev/vdb
Nov 14 12:39:37 user nova-compute[75258]: DEBUG os_brick.utils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[152def38-bb4b-4291-a5bb-660201f88aa6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[16694335-ad22-4285-9a9b-e2ce03bd9fdd]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[087229d1-2e7a-42e6-8715-3c0eb043a3c2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c355e967-ea27-4b79-ba09-3a8b1b5eb0b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:37 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09ac5c4-90da-4d59-8c54-39153754e6f0]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG os_brick.utils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updating existing volume attachment record: de2b9a96-1ab5-43f8-9ee2-5739e2c1f39a {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:37 user nova-compute[75258]: INFO nova.compute.manager [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Terminating instance
Nov 14 12:39:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-vif-unplugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] No waiting events found dispatching network-vif-unplugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-vif-unplugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] Acquiring lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] No waiting events found dispatching network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:38 user nova-compute[75258]: WARNING nova.compute.manager [req-aa1feeb5-75ba-4a79-b6d4-c52b8a22d030 req-cdaad164-6f41-4a00-b1c2-f56d160941d6 service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received unexpected event network-vif-plugged-f08eb35e-122b-42c2-9b2a-b8a2acdc37da for instance with vm_state active and task_state deleting.
Nov 14 12:39:38 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Instance destroyed successfully.
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lazy-loading 'resources' on Instance uuid 1ec48019-6248-4bcf-8c4d-bb07d135ce3f {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1733350812',display_name='tempest-VolumesAssistedSnapshotsTest-server-1733350812',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesassistedsnapshotstest-server-1733350812',id=8,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBIDdC3uutJgU7Z2RMTSlgNx4J53M89zgwHFe1WwI38sbNIQ4nl/uEIrqWHt5hyQ+Qbq2sq9d/Mz0iGOk9tQybObyt7EbkzehO2emx0qcW/zWtKWackHkl7rpz/fB5iMhw==',key_name='tempest-keypair-435714049',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7cc24bf0e654457e887d0d9d97223317',ramdisk_id='',reservation_id='r-p0jo85uh',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-1331516700',owner_user_name='tempest-VolumesAssistedSnapshotsTest-1331516700-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='75a39fef861d4c84bc7a420cada8f64b',uuid=1ec48019-6248-4bcf-8c4d-bb07d135ce3f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Converting VIF {"id": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "address": "fa:16:3e:75:b6:6b", "network": {"id": "d8442fb2-1b8e-4758-adb3-b69f3db2fb1b", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1997164106-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.20", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7cc24bf0e654457e887d0d9d97223317", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf08eb35e-12", "ovs_interfaceid": "f08eb35e-122b-42c2-9b2a-b8a2acdc37da", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:75:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=f08eb35e-122b-42c2-9b2a-b8a2acdc37da,network=Network(d8442fb2-1b8e-4758-adb3-b69f3db2fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08eb35e-12') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG os_vif [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=f08eb35e-122b-42c2-9b2a-b8a2acdc37da,network=Network(d8442fb2-1b8e-4758-adb3-b69f3db2fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08eb35e-12') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf08eb35e-12, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=063e2be1-9826-4f91-885d-c57f3565b2b5) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:38 user nova-compute[75258]: INFO os_vif [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:75:b6:6b,bridge_name='br-int',has_traffic_filtering=True,id=f08eb35e-122b-42c2-9b2a-b8a2acdc37da,network=Network(d8442fb2-1b8e-4758-adb3-b69f3db2fb1b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf08eb35e-12')
Nov 14 12:39:38 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Deleting instance files /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f_del
Nov 14 12:39:38 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Deletion of /opt/stack/data/nova/instances/1ec48019-6248-4bcf-8c4d-bb07d135ce3f_del complete
Nov 14 12:39:38 user nova-compute[75258]: INFO nova.compute.manager [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 12:39:38 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:39:38 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:39:39 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:39 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Took 0.96 seconds to deallocate network for instance.
Nov 14 12:39:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-7584c7d0-e0e3-4a39-9f13-d0a724b7cf40 req-e0347045-9b84-4b05-9810-1a0f077b6cbf service nova] [instance: 1ec48019-6248-4bcf-8c4d-bb07d135ce3f] Received event network-vif-deleted-f08eb35e-122b-42c2-9b2a-b8a2acdc37da {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:40 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:40 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.426s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:40 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Deleted allocations for instance 1ec48019-6248-4bcf-8c4d-bb07d135ce3f
Nov 14 12:39:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7eea1e7a-f4c4-4e73-82fa-5bbb63d35991 tempest-VolumesAssistedSnapshotsTest-1331516700 tempest-VolumesAssistedSnapshotsTest-1331516700-project-member] Lock "1ec48019-6248-4bcf-8c4d-bb07d135ce3f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.544s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gakQfJwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:42 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:42 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:42 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[62e600c0-b313-47f8-94d9-af5b6ea196d4]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:39:42 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[680e753b-9749-45c0-90df-aaff19ae239f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b] added
Nov 14 12:39:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[25c14107-0704-4f60-9ee3-4d1465840f5b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[829905cc-c004-4137-8056-beeaaf89b46a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gakQfJwM {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gakQfJwM" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a839d9dd-db0c-45ca-9e8c-5487d4aa9234]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gakQfJwM'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[633b36e4-5137-4a69-b7c7-7ece2a21ce69]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f869aee-98ce-4b7d-9b7f-fc8c1daa6dc1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[79879c51-589a-44a1-978f-1ac35a47acfd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260]
Nov 14 12:39:42 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2a3d95-54c8-467f-9d23-9beb42dda1f5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6af2065-e3cf-4fd0-b595-003166dfb7fb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:42 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] HCTL ('33', '-', '-', 0) found on session 14 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b90cc57-1e92-4dcf-95b1-ac9236c8e306]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Searching for a device in session 14 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:39:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gakQfJwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:39:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.309s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] <== connect_volume: return (1310ms) {'type': 'block', 'scsi_wwn': '26536343564353436', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26536343564353436', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:39:43 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'flavor' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:39:43 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:43 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:39:43 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:39:43 user nova-compute[75258]:   <serial>432ad3bd-37ce-445a-9b4e-7ab1a40ce96b</serial>
Nov 14 12:39:43 user nova-compute[75258]: </disk>
Nov 14 12:39:43 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:39:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No VIF found with MAC fa:16:3e:48:72:d4, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e6cac156-c304-4a2f-a9ff-392f3a0d755c tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.778s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:48 user nova-compute[75258]: DEBUG nova.objects.instance [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'flavor' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:49 user nova-compute[75258]: INFO nova.compute.manager [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Attaching volume ba9fd34a-c32d-47a9-9913-a41289c9fda2 to /dev/vdc
Nov 14 12:39:49 user nova-compute[75258]: DEBUG os_brick.utils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[426fa01e-03a4-499e-8e4e-c26dce2afb65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ca73551-ce58-49f5-b5b5-5b7d6778eded]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0fa0a3-df52-4745-ad0c-216635745e64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[216c0f1c-024a-43f3-85e2-2c0f08ac0a4c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:39:49 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:39:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de48fb66-8a44-4790-b6f6-321644e1b44e]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG os_brick.utils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:49 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updating existing volume attachment record: aee41a7e-11a1-47cd-8919-7c9dddb64cad {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:53 user nova-compute[75258]: INFO nova.compute.manager [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Terminating instance
Nov 14 12:39:53 user nova-compute[75258]: DEBUG nova.compute.manager [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:53 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3c2491e0-6711-4e46-9290-a4e4ad834cab is timed out.
Nov 14 12:39:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully detached device vdb from instance 3c2491e0-6711-4e46-9290-a4e4ad834cab from the live domain config.
Nov 14 12:39:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qloNbwjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:53 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-63289f75-cb68-4e5a-8863-76a28645929b req-db3111c7-80b9-4f78-8743-b6e0f35c173c service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-unplugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-63289f75-cb68-4e5a-8863-76a28645929b req-db3111c7-80b9-4f78-8743-b6e0f35c173c service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-63289f75-cb68-4e5a-8863-76a28645929b req-db3111c7-80b9-4f78-8743-b6e0f35c173c service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-63289f75-cb68-4e5a-8863-76a28645929b req-db3111c7-80b9-4f78-8743-b6e0f35c173c service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-63289f75-cb68-4e5a-8863-76a28645929b req-db3111c7-80b9-4f78-8743-b6e0f35c173c service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-unplugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-63289f75-cb68-4e5a-8863-76a28645929b req-db3111c7-80b9-4f78-8743-b6e0f35c173c service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-unplugged-84f9ac77-622e-413e-9490-b2be292eee05 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67325a5-b4ba-415c-9f5e-c7bda5299fbe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:39:53 user nova-compute[75258]: No targets found.
Nov 14 12:39:53 user nova-compute[75258]: iSNS:
Nov 14 12:39:53 user nova-compute[75258]: No targets found.
Nov 14 12:39:53 user nova-compute[75258]: STATIC:
Nov 14 12:39:53 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:39:53 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:53 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:53 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474
Nov 14 12:39:53 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:53 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:53 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:39:53 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:53 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:53 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b
Nov 14 12:39:53 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:53 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:53 user nova-compute[75258]: FIRMWARE:
Nov 14 12:39:53 user nova-compute[75258]: No targets found.
Nov 14 12:39:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:39:54 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:39:54 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b63a9aad-8eed-4c06-b18d-8a4fcf7a0a93]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4394e12-5f77-480a-9168-50513e417a97]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:54 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:54 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:54 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:54 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:54 user nova-compute[75258]: tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 (non-flash)
Nov 14 12:39:54 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:54 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:54 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7ab2e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d07e660f-53fc-498d-95c5-c75e970e84e8]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a39e98-a0b0-4b1b-8792-a8d39e68c2fd]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[606d9c8a-29d6-4f54-9ec9-ea757cb1a7e7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.065s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2471d903-8464-4c12-8095-eb09f4e06302]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c195e17-2897-4a7d-ba44-f92b0b4de8c6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbad6b7-ce47-4194-b3d1-0437b2e79032]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260]
Nov 14 12:39:54 user nova-compute[75258]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:54 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe7622f-9b7d-45d6-bd7d-8ac414157666]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== disconnect_volume: return (387ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:39:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Instance destroyed successfully.
Nov 14 12:39:54 user nova-compute[75258]: DEBUG nova.objects.instance [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lazy-loading 'resources' on Instance uuid fda05899-30ea-43b3-9191-f0a4a5bbba4d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:36:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1936237301',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1936237301',id=7,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBEiYMdlZc78YjBLYHErKM/2mzXYOPmsVRkstAQg2UXyHP0EsLmlxeXuaL7TzyAzFMyO5fHumC4eK6+HTreQRKAqVR4iJX/0GeHAZF1zahySHUPhoA48MHjAlq0RxO2nSg==',key_name='tempest-keypair-99056888',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4b829e058e44d7cb8eeb158f2b6ea72',ramdisk_id='',reservation_id='r-0rvn8n2u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-991165541',owner_user_name='tempest-TaggedAttachmentsTest-991165541-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d09eb01d5c6741b4ac32283284df01ff',uuid=fda05899-30ea-43b3-9191-f0a4a5bbba4d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converting VIF {"id": "84f9ac77-622e-413e-9490-b2be292eee05", "address": "fa:16:3e:de:48:6b", "network": {"id": "84136738-b5d0-4361-a57a-20743a8d3d50", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1890107808-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.233", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4b829e058e44d7cb8eeb158f2b6ea72", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap84f9ac77-62", "ovs_interfaceid": "84f9ac77-622e-413e-9490-b2be292eee05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:de:48:6b,bridge_name='br-int',has_traffic_filtering=True,id=84f9ac77-622e-413e-9490-b2be292eee05,network=Network(84136738-b5d0-4361-a57a-20743a8d3d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f9ac77-62') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG os_vif [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:48:6b,bridge_name='br-int',has_traffic_filtering=True,id=84f9ac77-622e-413e-9490-b2be292eee05,network=Network(84136738-b5d0-4361-a57a-20743a8d3d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f9ac77-62') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap84f9ac77-62, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1c3936a3-1b45-4b74-ad9e-575c144eb405) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:54 user nova-compute[75258]: INFO os_vif [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:de:48:6b,bridge_name='br-int',has_traffic_filtering=True,id=84f9ac77-622e-413e-9490-b2be292eee05,network=Network(84136738-b5d0-4361-a57a-20743a8d3d50),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap84f9ac77-62')
Nov 14 12:39:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Deleting instance files /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d_del
Nov 14 12:39:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Deletion of /opt/stack/data/nova/instances/fda05899-30ea-43b3-9191-f0a4a5bbba4d_del complete
Nov 14 12:39:54 user nova-compute[75258]: INFO nova.compute.manager [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Took 0.99 seconds to destroy the instance on the hypervisor.
Nov 14 12:39:54 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:39:54 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.objects.instance [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'flavor' on Instance uuid 3c2491e0-6711-4e46-9290-a4e4ad834cab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1db94807-88d3-417e-9722-bbbc187fcc8f tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.846s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.726s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:55 user nova-compute[75258]: INFO nova.compute.manager [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Terminating instance
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:55 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Took 0.72 seconds to deallocate network for instance.
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-97f37f13-9527-4aa0-aef4-f94b6ed881d1 req-5b860a36-794c-4235-a646-2d9314fd2d7d service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-deleted-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-820993df-8e23-4c4a-a31c-75da3cb65d76 req-dd4cbf33-9f6f-4328-8b02-d60c4aacf870 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-vif-unplugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-820993df-8e23-4c4a-a31c-75da3cb65d76 req-dd4cbf33-9f6f-4328-8b02-d60c4aacf870 service nova] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-820993df-8e23-4c4a-a31c-75da3cb65d76 req-dd4cbf33-9f6f-4328-8b02-d60c4aacf870 service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-820993df-8e23-4c4a-a31c-75da3cb65d76 req-dd4cbf33-9f6f-4328-8b02-d60c4aacf870 service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-820993df-8e23-4c4a-a31c-75da3cb65d76 req-dd4cbf33-9f6f-4328-8b02-d60c4aacf870 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] No waiting events found dispatching network-vif-unplugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-820993df-8e23-4c4a-a31c-75da3cb65d76 req-dd4cbf33-9f6f-4328-8b02-d60c4aacf870 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-vif-unplugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:55 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Deleted allocations for instance fda05899-30ea-43b3-9191-f0a4a5bbba4d
Nov 14 12:39:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-8a8b30b9-11c0-4145-b5ee-302e970f7939 tempest-TaggedAttachmentsTest-991165541 tempest-TaggedAttachmentsTest-991165541-project-member] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.368s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Instance destroyed successfully.
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'resources' on Instance uuid 3c2491e0-6711-4e46-9290-a4e4ad834cab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1755229488',display_name='tempest-VolumesSnapshotTestJSON-instance-1755229488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1755229488',id=11,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAU6LQ6eJBo2NWThDRYWFv0M2Q+TjnTFTARHFxtgOlI9+WYt/5EgidHl+dkr9jQYAhrRrLvCzp0i7UX2/C6Tyqx9Gqz4UteYOuOoXGy9psEtQGEuFlg1MekASyZRQvN2xA==',key_name='tempest-keypair-206532187',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6be68d1d7154b8d9ca0a763c1d65617',ramdisk_id='',reservation_id='r-3qfgsc3t',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1911480704',owner_user_name='tempest-VolumesSnapshotTestJSON-1911480704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d81b2cffea334578955e14613341e85e',uuid=3c2491e0-6711-4e46-9290-a4e4ad834cab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converting VIF {"id": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "address": "fa:16:3e:d5:a4:6f", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9c41aa5-52", "ovs_interfaceid": "e9c41aa5-5249-4e0b-8acb-4204a526efd2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a4:6f,bridge_name='br-int',has_traffic_filtering=True,id=e9c41aa5-5249-4e0b-8acb-4204a526efd2,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c41aa5-52') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_vif [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a4:6f,bridge_name='br-int',has_traffic_filtering=True,id=e9c41aa5-5249-4e0b-8acb-4204a526efd2,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c41aa5-52') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9c41aa5-52, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37f9a816-d767-4b1d-b34b-a28f405aca0c) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:56 user nova-compute[75258]: INFO os_vif [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d5:a4:6f,bridge_name='br-int',has_traffic_filtering=True,id=e9c41aa5-5249-4e0b-8acb-4204a526efd2,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9c41aa5-52')
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEqutngz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:56 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qloNbwjD', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:39:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[466c5c79-98c2-4d08-b7f2-436ac0db75b0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:39:56 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[607252cf-d8b8-41e7-8abc-5c131b0182a2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2] added
Nov 14 12:39:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6eb8113-dbb5-4dd9-b01a-940e81fe5dab]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8c89548-88c2-49d9-a158-97b2df43a97b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEqutngz {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BEqutngz" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df79eae4-d56c-43d3-92f2-6d0cb5733fb9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BEqutngz'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49076f2-a8b8-4f75-bf82-ddb1f7910279]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4523dd27-f80e-433e-a11d-8b2a13d906c3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-963097d8-68d2-4856-b73e-9b524ea46a30 req-fa0c89a6-6de6-48c0-b71f-2f4968fc6eec service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received event network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-963097d8-68d2-4856-b73e-9b524ea46a30 req-fa0c89a6-6de6-48c0-b71f-2f4968fc6eec service nova] Acquiring lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-963097d8-68d2-4856-b73e-9b524ea46a30 req-fa0c89a6-6de6-48c0-b71f-2f4968fc6eec service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-963097d8-68d2-4856-b73e-9b524ea46a30 req-fa0c89a6-6de6-48c0-b71f-2f4968fc6eec service nova] Lock "fda05899-30ea-43b3-9191-f0a4a5bbba4d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-963097d8-68d2-4856-b73e-9b524ea46a30 req-fa0c89a6-6de6-48c0-b71f-2f4968fc6eec service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] No waiting events found dispatching network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:56 user nova-compute[75258]: WARNING nova.compute.manager [req-963097d8-68d2-4856-b73e-9b524ea46a30 req-fa0c89a6-6de6-48c0-b71f-2f4968fc6eec service nova] [instance: fda05899-30ea-43b3-9191-f0a4a5bbba4d] Received unexpected event network-vif-plugged-84f9ac77-622e-413e-9490-b2be292eee05 for instance with vm_state deleted and task_state None.
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[217cb081-f27b-475a-873b-5020431aa60b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260]
Nov 14 12:39:56 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260] successful.
Nov 14 12:39:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[96220d6f-1d31-4d36-8dbf-aa6278c95510]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95a346a7-b2f2-47bf-a317-6874bcc98e00]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.303s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] HCTL ('35', '-', '-', 0) found on session 15 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[414340bf-7f8c-4843-9cc5-c7b2ed59317c]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Searching for a device in session 15 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:39:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEqutngz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26139313135646533', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26139313135646533', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.objects.instance [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'flavor' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[754e5331-efe9-46e6-9772-856f83cfc34a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:39:57 user nova-compute[75258]: No targets found.
Nov 14 12:39:57 user nova-compute[75258]: iSNS:
Nov 14 12:39:57 user nova-compute[75258]: No targets found.
Nov 14 12:39:57 user nova-compute[75258]: STATIC:
Nov 14 12:39:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2
Nov 14 12:39:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:39:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:39:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:57 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b
Nov 14 12:39:57 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:39:57 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:39:57 user nova-compute[75258]: FIRMWARE:
Nov 14 12:39:57 user nova-compute[75258]: No targets found.
Nov 14 12:39:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:39:57 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:39:57 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:69053c46-fd0f-4f28-bdcf-49d9c018a474', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:39:57 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:57 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:39:57 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 12:39:57 user nova-compute[75258]:   <serial>ba9fd34a-c32d-47a9-9913-a41289c9fda2</serial>
Nov 14 12:39:57 user nova-compute[75258]: </disk>
Nov 14 12:39:57 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f656dc0b-aae2-46d5-8544-b7d3e3584676]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[802c2a8a-8c92-4856-9bac-f264f7bd152b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:57 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:57 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:39:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:39:57 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:39:57 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:39:57 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:39:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4ac110b80>, {}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Disconnecting from: [] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.074s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== disconnect_volume: return (1405ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:39:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Deleting instance files /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab_del
Nov 14 12:39:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Deletion of /opt/stack/data/nova/instances/3c2491e0-6711-4e46-9290-a4e4ad834cab_del complete
Nov 14 12:39:57 user nova-compute[75258]: INFO nova.compute.manager [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Took 2.33 seconds to destroy the instance on the hypervisor.
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-c341a7fa-2350-4067-a443-a482c81d9e15 req-8752bf03-050a-4464-9490-0a4ba8cd59bc service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c341a7fa-2350-4067-a443-a482c81d9e15 req-8752bf03-050a-4464-9490-0a4ba8cd59bc service nova] Acquiring lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c341a7fa-2350-4067-a443-a482c81d9e15 req-8752bf03-050a-4464-9490-0a4ba8cd59bc service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c341a7fa-2350-4067-a443-a482c81d9e15 req-8752bf03-050a-4464-9490-0a4ba8cd59bc service nova] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-c341a7fa-2350-4067-a443-a482c81d9e15 req-8752bf03-050a-4464-9490-0a4ba8cd59bc service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] No waiting events found dispatching network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:39:57 user nova-compute[75258]: WARNING nova.compute.manager [req-c341a7fa-2350-4067-a443-a482c81d9e15 req-8752bf03-050a-4464-9490-0a4ba8cd59bc service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received unexpected event network-vif-plugged-e9c41aa5-5249-4e0b-8acb-4204a526efd2 for instance with vm_state active and task_state deleting.
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:39:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] No VIF found with MAC fa:16:3e:48:72:d4, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:39:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-73f9a9ae-8b20-4060-8b1e-56005724ff91 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.999s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:39:58 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:39:58 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Took 1.31 seconds to deallocate network for instance.
Nov 14 12:39:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-a60e28be-2fa0-4361-a4d4-31a648758801 req-feadb68c-41f6-4666-a41d-0284cd8516b7 service nova] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Received event network-vif-deleted-e9c41aa5-5249-4e0b-8acb-4204a526efd2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:39:58 user nova-compute[75258]: WARNING nova.volume.cinder [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Attachment d8b1c9c6-71e2-492c-9f79-c47106559979 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = d8b1c9c6-71e2-492c-9f79-c47106559979. (HTTP 404) (Request-ID: req-593da424-db34-404b-a413-bf8e2e931c74)
Nov 14 12:39:58 user nova-compute[75258]: INFO nova.compute.manager [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: 3c2491e0-6711-4e46-9290-a4e4ad834cab] Took 0.03 seconds to detach 1 volumes for instance.
Nov 14 12:39:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:39:59 user nova-compute[75258]: INFO nova.compute.manager [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Detaching volume ba9fd34a-c32d-47a9-9913-a41289c9fda2
Nov 14 12:39:59 user nova-compute[75258]: INFO nova.virt.block_device [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Attempting to driver detach volume ba9fd34a-c32d-47a9-9913-a41289c9fda2 from mountpoint /dev/vdc
Nov 14 12:39:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Attempting to detach device vdc from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:39:59 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:59 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:39:59 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 12:39:59 user nova-compute[75258]:   <serial>ba9fd34a-c32d-47a9-9913-a41289c9fda2</serial>
Nov 14 12:39:59 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 12:39:59 user nova-compute[75258]: </disk>
Nov 14 12:39:59 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Successfully detached device vdc from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the persistent domain config.
Nov 14 12:39:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:39:59 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:39:59 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:39:59 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 12:39:59 user nova-compute[75258]:   <serial>ba9fd34a-c32d-47a9-9913-a41289c9fda2</serial>
Nov 14 12:39:59 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 12:39:59 user nova-compute[75258]: </disk>
Nov 14 12:39:59 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.602s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:59 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Deleted allocations for instance 3c2491e0-6711-4e46-9290-a4e4ad834cab
Nov 14 12:39:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e55e1a85-280b-4006-bc61-60f1e9519d9e tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "3c2491e0-6711-4e46-9290-a4e4ad834cab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.490s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:39:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquired lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'info_cache' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:01 user nova-compute[75258]: DEBUG nova.objects.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Releasing lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:40:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance destroyed successfully.
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'resources' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.objects.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_vif [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap088cce2a-36, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e7e2888a-3b82-4877-875c-d90842bc6149) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:02 user nova-compute[75258]: INFO os_vif [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36')
Nov 14 12:40:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EonGjVlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:40:02 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.071s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7b90877-3990-45ab-bf9b-4b2fcd84345a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:40:02 user nova-compute[75258]: No targets found.
Nov 14 12:40:02 user nova-compute[75258]: iSNS:
Nov 14 12:40:02 user nova-compute[75258]: No targets found.
Nov 14 12:40:02 user nova-compute[75258]: STATIC:
Nov 14 12:40:02 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2
Nov 14 12:40:02 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:02 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:02 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:40:02 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:02 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:02 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:40:02 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:02 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:02 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b
Nov 14 12:40:02 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:02 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:02 user nova-compute[75258]: FIRMWARE:
Nov 14 12:40:02 user nova-compute[75258]: No targets found.
Nov 14 12:40:02 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:40:02 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:40:02 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8356a67a-ee20-454d-8d84-4cc2b47b4ee9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abc55cd-f302-441d-88b7-3f5c6c0ad2e1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:02 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:02 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:02 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:02 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:02 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:02 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:02 user nova-compute[75258]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:02 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7d6290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77'): ({'sdf'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Removing single pathed devices sdf {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b98279-d9c8-4e8f-ba15-cfc0a65bf8fe]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d881d5a-4438-4d8b-9883-15da9a6e6197]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flushing IO for device /dev/sdf {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24cf6a62-8ff1-4eff-9e6c-10759cf10d17]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:02 user nova-compute[75258]: INFO nova.compute.manager [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attaching volume 48c36855-85bb-4a4d-bb24-6ae4652f10a6 to /dev/vdb
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1e6c900-cee0-468f-bada-87dc0f6bfe80]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce66e1ab-ba58-427e-b018-6ae565a3ab67]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG os_brick.utils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:40:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ab9712-a4cb-4676-b257-52ee3beb2445]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec76111-d0c1-4fe1-92ef-f635f8b377e1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d008fea-bb27-4254-b4b7-d01e6106a216]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]
Nov 14 12:40:03 user nova-compute[75258]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.
Nov 14 12:40:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e3edb-2495-4cb9-89d4-7fc926a05fb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1161058f-f656-4041-9f21-069ee127f472]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1db10f65-db98-4288-8931-75ebf9d1be9c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.362s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== disconnect_volume: return (363ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Start _get_guest_xml network_info=[{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EonGjVlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'ac186509-f835-453a-b683-c6d3901babba', 'attached_at': '', 'detached_at': '', 'volume_id': '379c71d5-e136-4ba2-b189-a24752992f77', 'serial': '379c71d5-e136-4ba2-b189-a24752992f77'}, 'device_type': 'disk', 'attachment_id': '8537eda6-defb-48fa-b3b2-fbe630e53f88', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'numa_topology' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:40:03 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c80ab4-6054-4c63-abc9-9c056a603910]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.utils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating existing volume attachment record: c86bdb0c-8486-4ebe-849d-9df5a3c31d98 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:40:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EonGjVlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:40:03 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:40:03 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:40:03 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a61a0dc7-1341-43a4-941e-27258cb75a86]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:40:03 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5797438c-d499-4180-8940-a06f6504e116]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77] added
Nov 14 12:40:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e273210-062f-4343-a084-44820b2fa4b2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5055e7c8-8c83-4505-ade4-81dfdc41077f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EonGjVlQ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v EonGjVlQ" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d166eadb-c932-4145-8d69-895dc564f0f8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'EonGjVlQ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a016486-4f30-49c4-8ed8-5f4835805027]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[704dc171-f13a-4d0a-a6a0-9e20b1befe32]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd024b83-f1c3-4713-98c5-5c635ce8ec2a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]
Nov 14 12:40:03 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.
Nov 14 12:40:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2aa030-48ca-4605-b56c-60844d70a673]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d9c15bd-9863-4fbe-a804-dc373503bf63]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] HCTL ('36', '-', '-', 0) found on session 16 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f27795b6-fb2f-4c0c-9073-8512510b0ab4]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching for a device in session 16 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EonGjVlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:40:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.329s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23565336465303236', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23565336465303236', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'pci_devices' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG nova.objects.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:40:04 user nova-compute[75258]:   <uuid>ac186509-f835-453a-b683-c6d3901babba</uuid>
Nov 14 12:40:04 user nova-compute[75258]:   <name>instance-00000003</name>
Nov 14 12:40:04 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:40:04 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:40:04 user nova-compute[75258]:   <metadata>
Nov 14 12:40:04 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:40:04 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:40:04 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeTestJSON-server-1628417232</nova:name>
Nov 14 12:40:04 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:40:03</nova:creationTime>
Nov 14 12:40:04 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:40:04 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:40:04 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:40:04 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:40:04 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:40:04 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:40:04 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:40:04 user nova-compute[75258]:       <nova:owner>
Nov 14 12:40:04 user nova-compute[75258]:         <nova:user uuid="807e1725870b4bca88785bd3f81aa06b">tempest-AttachVolumeTestJSON-528350005-project-member</nova:user>
Nov 14 12:40:04 user nova-compute[75258]:         <nova:project uuid="84d45cf00d6749eabfd3bc56b38a5d4a">tempest-AttachVolumeTestJSON-528350005</nova:project>
Nov 14 12:40:04 user nova-compute[75258]:       </nova:owner>
Nov 14 12:40:04 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:40:04 user nova-compute[75258]:       <nova:ports>
Nov 14 12:40:04 user nova-compute[75258]:         <nova:port uuid="088cce2a-366c-4b1e-a9cd-f9dba80599b0">
Nov 14 12:40:04 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 12:40:04 user nova-compute[75258]:         </nova:port>
Nov 14 12:40:04 user nova-compute[75258]:       </nova:ports>
Nov 14 12:40:04 user nova-compute[75258]:     </nova:instance>
Nov 14 12:40:04 user nova-compute[75258]:   </metadata>
Nov 14 12:40:04 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:40:04 user nova-compute[75258]:     <system>
Nov 14 12:40:04 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:40:04 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:40:04 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:40:04 user nova-compute[75258]:       <entry name="serial">ac186509-f835-453a-b683-c6d3901babba</entry>
Nov 14 12:40:04 user nova-compute[75258]:       <entry name="uuid">ac186509-f835-453a-b683-c6d3901babba</entry>
Nov 14 12:40:04 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:40:04 user nova-compute[75258]:     </system>
Nov 14 12:40:04 user nova-compute[75258]:   </sysinfo>
Nov 14 12:40:04 user nova-compute[75258]:   <os>
Nov 14 12:40:04 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:40:04 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:40:04 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:40:04 user nova-compute[75258]:   </os>
Nov 14 12:40:04 user nova-compute[75258]:   <features>
Nov 14 12:40:04 user nova-compute[75258]:     <acpi/>
Nov 14 12:40:04 user nova-compute[75258]:     <apic/>
Nov 14 12:40:04 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:40:04 user nova-compute[75258]:   </features>
Nov 14 12:40:04 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:40:04 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:40:04 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:40:04 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:40:04 user nova-compute[75258]:   </clock>
Nov 14 12:40:04 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:40:04 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:40:04 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:40:04 user nova-compute[75258]:   </cpu>
Nov 14 12:40:04 user nova-compute[75258]:   <devices>
Nov 14 12:40:04 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:40:04 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:40:04 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk"/>
Nov 14 12:40:04 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:40:04 user nova-compute[75258]:     </disk>
Nov 14 12:40:04 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:40:04 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:40:04 user nova-compute[75258]:       <source dev="/dev/sde"/>
Nov 14 12:40:04 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:40:04 user nova-compute[75258]:       <serial>379c71d5-e136-4ba2-b189-a24752992f77</serial>
Nov 14 12:40:04 user nova-compute[75258]:     </disk>
Nov 14 12:40:04 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:40:04 user nova-compute[75258]:       <mac address="fa:16:3e:5e:d1:fb"/>
Nov 14 12:40:04 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:40:04 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:40:04 user nova-compute[75258]:       <target dev="tap088cce2a-36"/>
Nov 14 12:40:04 user nova-compute[75258]:     </interface>
Nov 14 12:40:04 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:40:04 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/console.log" append="off"/>
Nov 14 12:40:04 user nova-compute[75258]:     </serial>
Nov 14 12:40:04 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:40:04 user nova-compute[75258]:     <video>
Nov 14 12:40:04 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:40:04 user nova-compute[75258]:     </video>
Nov 14 12:40:04 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:40:04 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:40:04 user nova-compute[75258]:     </rng>
Nov 14 12:40:04 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:40:04 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:40:04 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:40:04 user nova-compute[75258]:     </memballoon>
Nov 14 12:40:04 user nova-compute[75258]:   </devices>
Nov 14 12:40:04 user nova-compute[75258]: </domain>
Nov 14 12:40:04 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.objects.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Cannot resize image /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'migration_context' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.objects.base [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:38:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG os_vif [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1d275ba-3ffa-5676-9a4e-6918f5a8ad5c', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap088cce2a-36, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap088cce2a-36, col_values=(('qos', UUID('ddbb6b61-eab4-4990-bc63-8ea6f826346e')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap088cce2a-36, col_values=(('external_ids', {'iface-id': '088cce2a-366c-4b1e-a9cd-f9dba80599b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:d1:fb', 'vm-uuid': 'ac186509-f835-453a-b683-c6d3901babba'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:05 user nova-compute[75258]: INFO os_vif [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36')
Nov 14 12:40:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-67d705d5-0b62-4565-8863-59e112f2a050 req-e0c3ff21-7b33-403d-ae5f-ffd68a01a585 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-67d705d5-0b62-4565-8863-59e112f2a050 req-e0c3ff21-7b33-403d-ae5f-ffd68a01a585 service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-67d705d5-0b62-4565-8863-59e112f2a050 req-e0c3ff21-7b33-403d-ae5f-ffd68a01a585 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-67d705d5-0b62-4565-8863-59e112f2a050 req-e0c3ff21-7b33-403d-ae5f-ffd68a01a585 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-67d705d5-0b62-4565-8863-59e112f2a050 req-e0c3ff21-7b33-403d-ae5f-ffd68a01a585 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:40:07 user nova-compute[75258]: WARNING nova.compute.manager [req-67d705d5-0b62-4565-8863-59e112f2a050 req-e0c3ff21-7b33-403d-ae5f-ffd68a01a585 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state stopped and task_state powering-on.
Nov 14 12:40:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RaviCjZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:40:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:40:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:40:07 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ede94e-393d-42c5-8fbb-ad035dd64ca5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:40:07 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d0bdb9-762c-45cd-9659-37bb87eed127]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6] added
Nov 14 12:40:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4665de6-49af-4ded-94d1-3f7b275c0efb]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f368ce03-13f5-4217-af96-93d0728ac045]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RaviCjZI {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RaviCjZI" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4616a4f2-f7ec-4b4b-af7c-bc608245bb76]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RaviCjZI'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98811e6-ee9e-46e2-ade3-ae04b9b5d7ed]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[791849e5-c298-45f1-81ca-ffb5e4b5982d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:07 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:07 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:07 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:07 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:07 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:07 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:40:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f610a50f-24ad-4297-b825-4278540e996e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260]
Nov 14 12:40:08 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260] successful.
Nov 14 12:40:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3018ea9c-e75e-466d-8270-dfe27b5706d4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e961eb30-9c9d-4863-8222-349d0ceeee4a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)
Nov 14 12:40:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.313s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] HCTL ('37', '-', '-', 0) found on session 17 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[facfad95-0cc0-4f8f-9247-34128d1de9fd]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Searching for a device in session 17 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RaviCjZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.345s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== connect_volume: return (1346ms) {'type': 'block', 'scsi_wwn': '23561623764303931', 'path': '/dev/sdf'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561623764303931', 'path': '/dev/sdf'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.objects.instance [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:40:09 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:40:09 user nova-compute[75258]:   <source dev="/dev/sdf"/>
Nov 14 12:40:09 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:40:09 user nova-compute[75258]:   <serial>48c36855-85bb-4a4d-bb24-6ae4652f10a6</serial>
Nov 14 12:40:09 user nova-compute[75258]: </disk>
Nov 14 12:40:09 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:40:09 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance rebooted successfully.
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e26f691d-0e26-498a-a317-a765955c41a4 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-dc558c1c-b12c-447b-80fa-990e31c084dc req-4dc7d2bd-71d1-476c-85cf-cf0d61a877d8 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dc558c1c-b12c-447b-80fa-990e31c084dc req-4dc7d2bd-71d1-476c-85cf-cf0d61a877d8 service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dc558c1c-b12c-447b-80fa-990e31c084dc req-4dc7d2bd-71d1-476c-85cf-cf0d61a877d8 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dc558c1c-b12c-447b-80fa-990e31c084dc req-4dc7d2bd-71d1-476c-85cf-cf0d61a877d8 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-dc558c1c-b12c-447b-80fa-990e31c084dc req-4dc7d2bd-71d1-476c-85cf-cf0d61a877d8 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:40:09 user nova-compute[75258]: WARNING nova.compute.manager [req-dc558c1c-b12c-447b-80fa-990e31c084dc req-4dc7d2bd-71d1-476c-85cf-cf0d61a877d8 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state stopped and task_state powering-on.
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No VIF found with MAC fa:16:3e:e8:ff:7e, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-69317a70-6f9c-47d0-aaea-2518c3fe12a7 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.804s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:12 user nova-compute[75258]: INFO nova.compute.manager [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Detaching volume 48c36855-85bb-4a4d-bb24-6ae4652f10a6
Nov 14 12:40:12 user nova-compute[75258]: INFO nova.virt.block_device [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attempting to driver detach volume 48c36855-85bb-4a4d-bb24-6ae4652f10a6 from mountpoint /dev/vdb
Nov 14 12:40:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Attempting to detach device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:40:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:40:12 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:40:12 user nova-compute[75258]:   <source dev="/dev/sdf"/>
Nov 14 12:40:12 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:40:12 user nova-compute[75258]:   <serial>48c36855-85bb-4a4d-bb24-6ae4652f10a6</serial>
Nov 14 12:40:12 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:40:12 user nova-compute[75258]: </disk>
Nov 14 12:40:12 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:40:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config.
Nov 14 12:40:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:40:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:40:12 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:40:12 user nova-compute[75258]:   <source dev="/dev/sdf"/>
Nov 14 12:40:12 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:40:12 user nova-compute[75258]:   <serial>48c36855-85bb-4a4d-bb24-6ae4652f10a6</serial>
Nov 14 12:40:12 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:40:12 user nova-compute[75258]: </disk>
Nov 14 12:40:12 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:40:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updating instance_info_cache with network_info: [{"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-3121053b-59aa-4412-aee7-a4b54d99d50d" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a/disk --force-share --output=json" returned: 0 in 0.240s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.221s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:40:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7667MB free_disk=25.3951416015625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3121053b-59aa-4412-aee7-a4b54d99d50d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4cd80282-24f6-4b44-bb13-f9586d478364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance fcb3fb92-cf4c-4258-a498-b768d49c054b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance eab53582-4a5b-4edd-bb16-c028d3abf7f7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 50b47c33-9bbb-48f5-b695-11c2986a458a actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:40:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:40:18 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:40:18 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:40:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:40:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.572s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 4cd80282-24f6-4b44-bb13-f9586d478364 is timed out.
Nov 14 12:40:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Successfully detached device vdc from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the live domain config.
Nov 14 12:40:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BEqutngz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:40:19 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d32eb49-0cdd-4580-b3e3-e7e587ca4d61]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:40:19 user nova-compute[75258]: No targets found.
Nov 14 12:40:19 user nova-compute[75258]: iSNS:
Nov 14 12:40:19 user nova-compute[75258]: No targets found.
Nov 14 12:40:19 user nova-compute[75258]: STATIC:
Nov 14 12:40:19 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2
Nov 14 12:40:19 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:19 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:19 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:40:19 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:19 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:19 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:40:19 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:19 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:19 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b
Nov 14 12:40:19 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:19 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:19 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6
Nov 14 12:40:19 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:19 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:19 user nova-compute[75258]: FIRMWARE:
Nov 14 12:40:19 user nova-compute[75258]: No targets found.
Nov 14 12:40:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:40:19 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:40:19 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3c74d31-1112-47ee-960c-15465217e465]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[73437ffe-a368-43b0-8ea6-5382a0aaf8e6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)
Nov 14 12:40:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c765480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6e8543-7bea-444d-9de7-2152727c8dda]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[66565323-5a6d-41e5-ab69-887ba0010831]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9271d12a-3963-45aa-9071-6fd38dbcc900]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dfd9b06-c697-4ca6-bd61-cf7c261e7bc1]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:40:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6ae3ac3-d795-4215-8b20-41aba5403334]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5240d225-fbbd-4585-a0a4-d232e4cd3bbe]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260]
Nov 14 12:40:20 user nova-compute[75258]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2, portal: 172.16.0.220,3260] successful.
Nov 14 12:40:20 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ba9fd34a-c32d-47a9-9913-a41289c9fda2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3a9a153-3397-4125-9db8-dd8974263d50]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] <== disconnect_volume: return (308ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:40:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:21 user nova-compute[75258]: DEBUG nova.objects.instance [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'flavor' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-30494f9a-814a-4971-a620-b0222d2ca781 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.039s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:40:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:40:22 user nova-compute[75258]: INFO nova.compute.claims [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Claim successful on node user
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.439s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:40:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:40:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Creating image(s)
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "/opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "/opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "/opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG nova.policy [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ce66d8c301347ce97b52c83b58a5cf0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea036c5b20cf4a3f9083dbae82dc7f2d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.216s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.213s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk 1073741824" returned: 0 in 0.082s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Checking if we can resize image /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Successfully created port: 48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Cannot resize image /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Ensure instance console log exists: /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Successfully updated port: 48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquired lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-changed-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Refreshing instance network info cache due to event network-changed-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] Acquiring lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Updating instance_info_cache with network_info: [{"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Releasing lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Instance network_info: |[{"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] Acquired lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Refreshing network info cache for port 48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Start _get_guest_xml network_info=[{"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:40:25 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:25 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2117301397',display_name='tempest-TestVolumeSwap-server-2117301397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2117301397',id=17,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkr2ZNHO2r5mSYG7DboXgIC3TRwy1xE6TMZ/g2s/M74knly9jctMQKwypUgEPX+1gxUQT4Ya8DKdNFL0WcGTqq3KJ98HiF2sM+6OsR0dRwzxgbG3PYEBUXM+uGeRr9K6g==',key_name='tempest-keypair-23334534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea036c5b20cf4a3f9083dbae82dc7f2d',ramdisk_id='',reservation_id='r-lpxjgfks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1946407222',owner_user_name='tempest-TestVolumeSwap-1946407222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ce66d8c301347ce97b52c83b58a5cf0',uuid=10574d06-4168-43c2-bf6b-22a1a55febab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Converting VIF {"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=48dbd1aa-4424-4a29-8054-5a5d8d53bf8a,network=Network(1ae924d4-0297-4fd7-95cc-883a070c666b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbd1aa-44') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lazy-loading 'pci_devices' on Instance uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:40:25 user nova-compute[75258]:   <uuid>10574d06-4168-43c2-bf6b-22a1a55febab</uuid>
Nov 14 12:40:25 user nova-compute[75258]:   <name>instance-00000011</name>
Nov 14 12:40:25 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:40:25 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:40:25 user nova-compute[75258]:   <metadata>
Nov 14 12:40:25 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:40:25 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:40:25 user nova-compute[75258]:       <nova:name>tempest-TestVolumeSwap-server-2117301397</nova:name>
Nov 14 12:40:25 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:40:25</nova:creationTime>
Nov 14 12:40:25 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:40:25 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:40:25 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:40:25 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:40:25 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:40:25 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:40:25 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:40:25 user nova-compute[75258]:       <nova:owner>
Nov 14 12:40:25 user nova-compute[75258]:         <nova:user uuid="5ce66d8c301347ce97b52c83b58a5cf0">tempest-TestVolumeSwap-1946407222-project-member</nova:user>
Nov 14 12:40:25 user nova-compute[75258]:         <nova:project uuid="ea036c5b20cf4a3f9083dbae82dc7f2d">tempest-TestVolumeSwap-1946407222</nova:project>
Nov 14 12:40:25 user nova-compute[75258]:       </nova:owner>
Nov 14 12:40:25 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:40:25 user nova-compute[75258]:       <nova:ports>
Nov 14 12:40:25 user nova-compute[75258]:         <nova:port uuid="48dbd1aa-4424-4a29-8054-5a5d8d53bf8a">
Nov 14 12:40:25 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 12:40:25 user nova-compute[75258]:         </nova:port>
Nov 14 12:40:25 user nova-compute[75258]:       </nova:ports>
Nov 14 12:40:25 user nova-compute[75258]:     </nova:instance>
Nov 14 12:40:25 user nova-compute[75258]:   </metadata>
Nov 14 12:40:25 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:40:25 user nova-compute[75258]:     <system>
Nov 14 12:40:25 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:40:25 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:40:25 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:40:25 user nova-compute[75258]:       <entry name="serial">10574d06-4168-43c2-bf6b-22a1a55febab</entry>
Nov 14 12:40:25 user nova-compute[75258]:       <entry name="uuid">10574d06-4168-43c2-bf6b-22a1a55febab</entry>
Nov 14 12:40:25 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:40:25 user nova-compute[75258]:     </system>
Nov 14 12:40:25 user nova-compute[75258]:   </sysinfo>
Nov 14 12:40:25 user nova-compute[75258]:   <os>
Nov 14 12:40:25 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:40:25 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:40:25 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:40:25 user nova-compute[75258]:   </os>
Nov 14 12:40:25 user nova-compute[75258]:   <features>
Nov 14 12:40:25 user nova-compute[75258]:     <acpi/>
Nov 14 12:40:25 user nova-compute[75258]:     <apic/>
Nov 14 12:40:25 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:40:25 user nova-compute[75258]:   </features>
Nov 14 12:40:25 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:40:25 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:40:25 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:40:25 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:40:25 user nova-compute[75258]:   </clock>
Nov 14 12:40:25 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:40:25 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:40:25 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:40:25 user nova-compute[75258]:   </cpu>
Nov 14 12:40:25 user nova-compute[75258]:   <devices>
Nov 14 12:40:25 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:40:25 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:40:25 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk"/>
Nov 14 12:40:25 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:40:25 user nova-compute[75258]:     </disk>
Nov 14 12:40:25 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:40:25 user nova-compute[75258]:       <mac address="fa:16:3e:78:d2:8b"/>
Nov 14 12:40:25 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:40:25 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:40:25 user nova-compute[75258]:       <target dev="tap48dbd1aa-44"/>
Nov 14 12:40:25 user nova-compute[75258]:     </interface>
Nov 14 12:40:25 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:40:25 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/console.log" append="off"/>
Nov 14 12:40:25 user nova-compute[75258]:     </serial>
Nov 14 12:40:25 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:40:25 user nova-compute[75258]:     <video>
Nov 14 12:40:25 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:40:25 user nova-compute[75258]:     </video>
Nov 14 12:40:25 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:40:25 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:40:25 user nova-compute[75258]:     </rng>
Nov 14 12:40:25 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:40:25 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:40:25 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:40:25 user nova-compute[75258]:     </memballoon>
Nov 14 12:40:25 user nova-compute[75258]:   </devices>
Nov 14 12:40:25 user nova-compute[75258]: </domain>
Nov 14 12:40:25 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2117301397',display_name='tempest-TestVolumeSwap-server-2117301397',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2117301397',id=17,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkr2ZNHO2r5mSYG7DboXgIC3TRwy1xE6TMZ/g2s/M74knly9jctMQKwypUgEPX+1gxUQT4Ya8DKdNFL0WcGTqq3KJ98HiF2sM+6OsR0dRwzxgbG3PYEBUXM+uGeRr9K6g==',key_name='tempest-keypair-23334534',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea036c5b20cf4a3f9083dbae82dc7f2d',ramdisk_id='',reservation_id='r-lpxjgfks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-1946407222',owner_user_name='tempest-TestVolumeSwap-1946407222-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:40:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ce66d8c301347ce97b52c83b58a5cf0',uuid=10574d06-4168-43c2-bf6b-22a1a55febab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Converting VIF {"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=48dbd1aa-4424-4a29-8054-5a5d8d53bf8a,network=Network(1ae924d4-0297-4fd7-95cc-883a070c666b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbd1aa-44') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG os_vif [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=48dbd1aa-4424-4a29-8054-5a5d8d53bf8a,network=Network(1ae924d4-0297-4fd7-95cc-883a070c666b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbd1aa-44') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c4e94610-0fef-5df7-948e-f7b028f6253b', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap48dbd1aa-44, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap48dbd1aa-44, col_values=(('qos', UUID('c9b5bdd7-dc20-4b14-a58e-109b312cc452')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap48dbd1aa-44, col_values=(('external_ids', {'iface-id': '48dbd1aa-4424-4a29-8054-5a5d8d53bf8a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:d2:8b', 'vm-uuid': '10574d06-4168-43c2-bf6b-22a1a55febab'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:25 user nova-compute[75258]: INFO os_vif [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=48dbd1aa-4424-4a29-8054-5a5d8d53bf8a,network=Network(1ae924d4-0297-4fd7-95cc-883a070c666b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbd1aa-44')
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] No VIF found with MAC fa:16:3e:78:d2:8b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Updated VIF entry in instance network info cache for port 48dbd1aa-4424-4a29-8054-5a5d8d53bf8a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Updating instance_info_cache with network_info: [{"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:40:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-44e45315-f692-4e4b-a657-4cb2c0323742 req-62773f55-160b-4c75-8468-0b8b05b39af4 service nova] Releasing lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:40:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f4cafd9-d0e0-4f48-a86b-fd568977022a req-43eed230-d634-4dfb-be3f-e5ce2642905c service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f4cafd9-d0e0-4f48-a86b-fd568977022a req-43eed230-d634-4dfb-be3f-e5ce2642905c service nova] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f4cafd9-d0e0-4f48-a86b-fd568977022a req-43eed230-d634-4dfb-be3f-e5ce2642905c service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f4cafd9-d0e0-4f48-a86b-fd568977022a req-43eed230-d634-4dfb-be3f-e5ce2642905c service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f4cafd9-d0e0-4f48-a86b-fd568977022a req-43eed230-d634-4dfb-be3f-e5ce2642905c service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] No waiting events found dispatching network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:40:27 user nova-compute[75258]: WARNING nova.compute.manager [req-3f4cafd9-d0e0-4f48-a86b-fd568977022a req-43eed230-d634-4dfb-be3f-e5ce2642905c service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received unexpected event network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a for instance with vm_state building and task_state spawning.
Nov 14 12:40:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:40:29 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Instance spawned successfully.
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-75bc1a79-ce94-4f44-bdf8-4e6c5aab8fdf req-36e777d0-3948-47c1-a88b-8a1fb3050e8d service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75bc1a79-ce94-4f44-bdf8-4e6c5aab8fdf req-36e777d0-3948-47c1-a88b-8a1fb3050e8d service nova] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75bc1a79-ce94-4f44-bdf8-4e6c5aab8fdf req-36e777d0-3948-47c1-a88b-8a1fb3050e8d service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75bc1a79-ce94-4f44-bdf8-4e6c5aab8fdf req-36e777d0-3948-47c1-a88b-8a1fb3050e8d service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-75bc1a79-ce94-4f44-bdf8-4e6c5aab8fdf req-36e777d0-3948-47c1-a88b-8a1fb3050e8d service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] No waiting events found dispatching network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:40:29 user nova-compute[75258]: WARNING nova.compute.manager [req-75bc1a79-ce94-4f44-bdf8-4e6c5aab8fdf req-36e777d0-3948-47c1-a88b-8a1fb3050e8d service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received unexpected event network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a for instance with vm_state building and task_state spawning.
Nov 14 12:40:29 user nova-compute[75258]: INFO nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Took 5.63 seconds to spawn the instance on the hypervisor.
Nov 14 12:40:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:40:29 user nova-compute[75258]: INFO nova.compute.manager [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Took 6.45 seconds to build instance.
Nov 14 12:40:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5a457db-4ca1-4d99-b64a-1a70c65fe41e tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.554s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:32 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 is timed out.
Nov 14 12:40:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config.
Nov 14 12:40:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RaviCjZI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:40:32 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d765d42-f52f-4336-8b4f-a00fbbbb9381]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:40:32 user nova-compute[75258]: No targets found.
Nov 14 12:40:32 user nova-compute[75258]: iSNS:
Nov 14 12:40:32 user nova-compute[75258]: No targets found.
Nov 14 12:40:32 user nova-compute[75258]: STATIC:
Nov 14 12:40:32 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:40:32 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:32 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:32 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:40:32 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:32 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:32 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b
Nov 14 12:40:32 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:32 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:32 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6
Nov 14 12:40:32 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:40:32 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:40:32 user nova-compute[75258]: FIRMWARE:
Nov 14 12:40:32 user nova-compute[75258]: No targets found.
Nov 14 12:40:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:40:32 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:40:32 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[861530a9-a0ac-497c-ba70-b30ab9b8c131]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a0162f7-4821-44d6-b563-0d7d4e34c12e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:32 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:32 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:32 user nova-compute[75258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)
Nov 14 12:40:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:40:32 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:40:32 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:40:32 user nova-compute[75258]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 (non-flash)
Nov 14 12:40:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b44db490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6'): ({'sdf'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Removing single pathed devices sdf {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fd680d8-a290-4cfe-990a-cd59dd6bdfaf]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8fa354-1333-467c-a03d-b4e694a39e10]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Flushing IO for device /dev/sdf {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e44729-d9d6-4bd2-ae06-a5b5b1d8210b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:40:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.049s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfc3425d-fe04-4f2e-9c6e-78c247496670]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd2ea51e-3c37-4169-9b77-960ec23067f2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.092s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c36841-1ded-47f9-98e6-c136ab7073fd]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260]
Nov 14 12:40:33 user nova-compute[75258]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6, portal: 172.16.0.220,3260] successful.
Nov 14 12:40:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:48c36855-85bb-4a4d-bb24-6ae4652f10a6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bda146fe-c16a-4436-80c0-f34d2a7276ad]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== disconnect_volume: return (387ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:40:33 user nova-compute[75258]: INFO nova.compute.claims [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Claim successful on node user
Nov 14 12:40:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-931739ab-d8d7-4f18-8755-216fb6de4b26 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.843s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.523s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.network.neutron [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:40:34 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.policy [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd81b2cffea334578955e14613341e85e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b6be68d1d7154b8d9ca0a763c1d65617', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:40:34 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Creating image(s)
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "/opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "/opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "/opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.197s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk 1073741824" returned: 0 in 0.069s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Checking if we can resize image /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Successfully created port: af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Cannot resize image /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Ensure instance console log exists: /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Successfully updated port: af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquired lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-changed-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Refreshing instance network info cache due to event network-changed-af2f80aa-4b8b-4ba8-9b35-6ac29459178b. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] Acquiring lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Updating instance_info_cache with network_info: [{"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Releasing lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Instance network_info: |[{"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] Acquired lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Refreshing network info cache for port af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Start _get_guest_xml network_info=[{"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:40:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1318053202',display_name='tempest-VolumesSnapshotTestJSON-instance-1318053202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1318053202',id=18,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCnPb0eScVzwWooO5xCIr5T/s67Jkv4TPKqZx/p/3T//cmaUzOCpw5c/yA5Gx97VsulJEkBhrCFYTHnKqG4OJKkI3cSE59PsgfyXnRd8E2ksXzEkny41uSsVBUQzGB20A==',key_name='tempest-keypair-1198725233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6be68d1d7154b8d9ca0a763c1d65617',ramdisk_id='',reservation_id='r-0q31yb96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1911480704',owner_user_name='tempest-VolumesSnapshotTestJSON-1911480704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d81b2cffea334578955e14613341e85e',uuid=e4f541b4-6f64-4e49-9d46-5806aeba8ad8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converting VIF {"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:a7,bridge_name='br-int',has_traffic_filtering=True,id=af2f80aa-4b8b-4ba8-9b35-6ac29459178b,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2f80aa-4b') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'pci_devices' on Instance uuid e4f541b4-6f64-4e49-9d46-5806aeba8ad8 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:40:36 user nova-compute[75258]:   <uuid>e4f541b4-6f64-4e49-9d46-5806aeba8ad8</uuid>
Nov 14 12:40:36 user nova-compute[75258]:   <name>instance-00000012</name>
Nov 14 12:40:36 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:40:36 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:40:36 user nova-compute[75258]:   <metadata>
Nov 14 12:40:36 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:40:36 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:40:36 user nova-compute[75258]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1318053202</nova:name>
Nov 14 12:40:36 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:40:36</nova:creationTime>
Nov 14 12:40:36 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:40:36 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:40:36 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:40:36 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:40:36 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:40:36 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:40:36 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:40:36 user nova-compute[75258]:       <nova:owner>
Nov 14 12:40:36 user nova-compute[75258]:         <nova:user uuid="d81b2cffea334578955e14613341e85e">tempest-VolumesSnapshotTestJSON-1911480704-project-member</nova:user>
Nov 14 12:40:36 user nova-compute[75258]:         <nova:project uuid="b6be68d1d7154b8d9ca0a763c1d65617">tempest-VolumesSnapshotTestJSON-1911480704</nova:project>
Nov 14 12:40:36 user nova-compute[75258]:       </nova:owner>
Nov 14 12:40:36 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:40:36 user nova-compute[75258]:       <nova:ports>
Nov 14 12:40:36 user nova-compute[75258]:         <nova:port uuid="af2f80aa-4b8b-4ba8-9b35-6ac29459178b">
Nov 14 12:40:36 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 12:40:36 user nova-compute[75258]:         </nova:port>
Nov 14 12:40:36 user nova-compute[75258]:       </nova:ports>
Nov 14 12:40:36 user nova-compute[75258]:     </nova:instance>
Nov 14 12:40:36 user nova-compute[75258]:   </metadata>
Nov 14 12:40:36 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:40:36 user nova-compute[75258]:     <system>
Nov 14 12:40:36 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:40:36 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:40:36 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:40:36 user nova-compute[75258]:       <entry name="serial">e4f541b4-6f64-4e49-9d46-5806aeba8ad8</entry>
Nov 14 12:40:36 user nova-compute[75258]:       <entry name="uuid">e4f541b4-6f64-4e49-9d46-5806aeba8ad8</entry>
Nov 14 12:40:36 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:40:36 user nova-compute[75258]:     </system>
Nov 14 12:40:36 user nova-compute[75258]:   </sysinfo>
Nov 14 12:40:36 user nova-compute[75258]:   <os>
Nov 14 12:40:36 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:40:36 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:40:36 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:40:36 user nova-compute[75258]:   </os>
Nov 14 12:40:36 user nova-compute[75258]:   <features>
Nov 14 12:40:36 user nova-compute[75258]:     <acpi/>
Nov 14 12:40:36 user nova-compute[75258]:     <apic/>
Nov 14 12:40:36 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:40:36 user nova-compute[75258]:   </features>
Nov 14 12:40:36 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:40:36 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:40:36 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:40:36 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:40:36 user nova-compute[75258]:   </clock>
Nov 14 12:40:36 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:40:36 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:40:36 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:40:36 user nova-compute[75258]:   </cpu>
Nov 14 12:40:36 user nova-compute[75258]:   <devices>
Nov 14 12:40:36 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:40:36 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:40:36 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk"/>
Nov 14 12:40:36 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:40:36 user nova-compute[75258]:     </disk>
Nov 14 12:40:36 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:40:36 user nova-compute[75258]:       <mac address="fa:16:3e:4a:ce:a7"/>
Nov 14 12:40:36 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:40:36 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:40:36 user nova-compute[75258]:       <target dev="tapaf2f80aa-4b"/>
Nov 14 12:40:36 user nova-compute[75258]:     </interface>
Nov 14 12:40:36 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:40:36 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/console.log" append="off"/>
Nov 14 12:40:36 user nova-compute[75258]:     </serial>
Nov 14 12:40:36 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:40:36 user nova-compute[75258]:     <video>
Nov 14 12:40:36 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:40:36 user nova-compute[75258]:     </video>
Nov 14 12:40:36 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:40:36 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:40:36 user nova-compute[75258]:     </rng>
Nov 14 12:40:36 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:40:36 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:40:36 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:40:36 user nova-compute[75258]:     </memballoon>
Nov 14 12:40:36 user nova-compute[75258]:   </devices>
Nov 14 12:40:36 user nova-compute[75258]: </domain>
Nov 14 12:40:36 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1318053202',display_name='tempest-VolumesSnapshotTestJSON-instance-1318053202',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1318053202',id=18,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCnPb0eScVzwWooO5xCIr5T/s67Jkv4TPKqZx/p/3T//cmaUzOCpw5c/yA5Gx97VsulJEkBhrCFYTHnKqG4OJKkI3cSE59PsgfyXnRd8E2ksXzEkny41uSsVBUQzGB20A==',key_name='tempest-keypair-1198725233',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b6be68d1d7154b8d9ca0a763c1d65617',ramdisk_id='',reservation_id='r-0q31yb96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-1911480704',owner_user_name='tempest-VolumesSnapshotTestJSON-1911480704-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:40:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d81b2cffea334578955e14613341e85e',uuid=e4f541b4-6f64-4e49-9d46-5806aeba8ad8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converting VIF {"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:a7,bridge_name='br-int',has_traffic_filtering=True,id=af2f80aa-4b8b-4ba8-9b35-6ac29459178b,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2f80aa-4b') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG os_vif [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:a7,bridge_name='br-int',has_traffic_filtering=True,id=af2f80aa-4b8b-4ba8-9b35-6ac29459178b,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2f80aa-4b') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b285aade-52f6-54ed-89d8-6b66970d998e', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapaf2f80aa-4b, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapaf2f80aa-4b, col_values=(('qos', UUID('b96292cf-a674-4393-8096-4875ee1f13f7')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapaf2f80aa-4b, col_values=(('external_ids', {'iface-id': 'af2f80aa-4b8b-4ba8-9b35-6ac29459178b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4a:ce:a7', 'vm-uuid': 'e4f541b4-6f64-4e49-9d46-5806aeba8ad8'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:36 user nova-compute[75258]: INFO os_vif [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4a:ce:a7,bridge_name='br-int',has_traffic_filtering=True,id=af2f80aa-4b8b-4ba8-9b35-6ac29459178b,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2f80aa-4b')
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No VIF found with MAC fa:16:3e:4a:ce:a7, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Updated VIF entry in instance network info cache for port af2f80aa-4b8b-4ba8-9b35-6ac29459178b. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Updating instance_info_cache with network_info: [{"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:40:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-81c827e4-2e7a-4bac-9584-5d469c1392ca req-b07d2470-4513-44b4-a919-1da5244f87ff service nova] Releasing lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d4aa9749-10e9-4108-852b-439bf52ca909 req-b3359668-9f7f-4e54-905f-33b719b9b8f9 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4aa9749-10e9-4108-852b-439bf52ca909 req-b3359668-9f7f-4e54-905f-33b719b9b8f9 service nova] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4aa9749-10e9-4108-852b-439bf52ca909 req-b3359668-9f7f-4e54-905f-33b719b9b8f9 service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4aa9749-10e9-4108-852b-439bf52ca909 req-b3359668-9f7f-4e54-905f-33b719b9b8f9 service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d4aa9749-10e9-4108-852b-439bf52ca909 req-b3359668-9f7f-4e54-905f-33b719b9b8f9 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] No waiting events found dispatching network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:40:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d4aa9749-10e9-4108-852b-439bf52ca909 req-b3359668-9f7f-4e54-905f-33b719b9b8f9 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received unexpected event network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b for instance with vm_state building and task_state spawning.
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:40:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Instance spawned successfully.
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:40:40 user nova-compute[75258]: INFO nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Took 6.15 seconds to spawn the instance on the hypervisor.
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-ba936979-1fed-4822-9411-6b2473624f36 req-d05880bb-6712-48a9-aab9-2a5d39c7b0d8 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ba936979-1fed-4822-9411-6b2473624f36 req-d05880bb-6712-48a9-aab9-2a5d39c7b0d8 service nova] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ba936979-1fed-4822-9411-6b2473624f36 req-d05880bb-6712-48a9-aab9-2a5d39c7b0d8 service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ba936979-1fed-4822-9411-6b2473624f36 req-d05880bb-6712-48a9-aab9-2a5d39c7b0d8 service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-ba936979-1fed-4822-9411-6b2473624f36 req-d05880bb-6712-48a9-aab9-2a5d39c7b0d8 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] No waiting events found dispatching network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:40:40 user nova-compute[75258]: WARNING nova.compute.manager [req-ba936979-1fed-4822-9411-6b2473624f36 req-d05880bb-6712-48a9-aab9-2a5d39c7b0d8 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received unexpected event network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b for instance with vm_state building and task_state spawning.
Nov 14 12:40:40 user nova-compute[75258]: INFO nova.compute.manager [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Took 7.10 seconds to build instance.
Nov 14 12:40:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-592896c5-ad87-45bf-831d-d6689ec1ea21 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.207s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:40:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:40:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:40:49 user nova-compute[75258]: INFO nova.compute.manager [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Detaching volume 432ad3bd-37ce-445a-9b4e-7ab1a40ce96b
Nov 14 12:40:49 user nova-compute[75258]: INFO nova.virt.block_device [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Attempting to driver detach volume 432ad3bd-37ce-445a-9b4e-7ab1a40ce96b from mountpoint /dev/vdb
Nov 14 12:40:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Attempting to detach device vdb from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:40:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:40:49 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:40:49 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:40:49 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:40:49 user nova-compute[75258]:   <serial>432ad3bd-37ce-445a-9b4e-7ab1a40ce96b</serial>
Nov 14 12:40:49 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:40:49 user nova-compute[75258]: </disk>
Nov 14 12:40:49 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:40:49 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Successfully detached device vdb from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the persistent domain config.
Nov 14 12:40:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:40:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:40:49 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:40:49 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:40:49 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:40:49 user nova-compute[75258]:   <serial>432ad3bd-37ce-445a-9b4e-7ab1a40ce96b</serial>
Nov 14 12:40:49 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:40:49 user nova-compute[75258]: </disk>
Nov 14 12:40:49 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:40:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:40:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:40:59 user nova-compute[75258]: INFO nova.compute.manager [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Rescuing
Nov 14 12:40:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:40:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:40:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-acfb4ddc-eadc-4dd3-ac29-c924d6d46239 req-7029347b-b606-4293-b1df-d11f408f5aea service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-acfb4ddc-eadc-4dd3-ac29-c924d6d46239 req-7029347b-b606-4293-b1df-d11f408f5aea service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-acfb4ddc-eadc-4dd3-ac29-c924d6d46239 req-7029347b-b606-4293-b1df-d11f408f5aea service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-acfb4ddc-eadc-4dd3-ac29-c924d6d46239 req-7029347b-b606-4293-b1df-d11f408f5aea service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-acfb4ddc-eadc-4dd3-ac29-c924d6d46239 req-7029347b-b606-4293-b1df-d11f408f5aea service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:00 user nova-compute[75258]: WARNING nova.compute.manager [req-acfb4ddc-eadc-4dd3-ac29-c924d6d46239 req-7029347b-b606-4293-b1df-d11f408f5aea service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state rescuing.
Nov 14 12:41:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance destroyed successfully.
Nov 14 12:41:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Attempting a stable device rescue
Nov 14 12:41:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 12:41:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Creating image(s)
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "/opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG nova.objects.instance [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "1c9e890d089db7bda447341a45e98415b1709f2c" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "1c9e890d089db7bda447341a45e98415b1709f2c" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "fcb3fb92-cf4c-4258-a498-b768d49c054b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:01 user nova-compute[75258]: INFO nova.compute.manager [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Terminating instance
Nov 14 12:41:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Instance destroyed successfully.
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lazy-loading 'resources' on Instance uuid fcb3fb92-cf4c-4258-a498-b768d49c054b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1887555196',display_name='tempest-VolumesActionsTest-instance-1887555196',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1887555196',id=14,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:39:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='881b748cca5c4f31b10b931164e5e1aa',ramdisk_id='',reservation_id='r-5n25omax',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1666751966',owner_user_name='tempest-VolumesActionsTest-1666751966-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:39:17Z,user_data=None,user_id='6a1cc10ee97a471680b98fcf53c94173',uuid=fcb3fb92-cf4c-4258-a498-b768d49c054b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converting VIF {"id": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "address": "fa:16:3e:d9:84:88", "network": {"id": "50771b40-d1fa-4653-9116-486319a534b6", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1049331553-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "881b748cca5c4f31b10b931164e5e1aa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1bab2bf8-d2", "ovs_interfaceid": "1bab2bf8-d282-4d50-91ff-bc054fc2abc6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d9:84:88,bridge_name='br-int',has_traffic_filtering=True,id=1bab2bf8-d282-4d50-91ff-bc054fc2abc6,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bab2bf8-d2') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG os_vif [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:84:88,bridge_name='br-int',has_traffic_filtering=True,id=1bab2bf8-d282-4d50-91ff-bc054fc2abc6,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bab2bf8-d2') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1bab2bf8-d2, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.part --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.virt.images [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] d6c38c08-08c5-437b-9e27-c63cbfd71268 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.part /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=154f0c87-7e07-42c4-b0b8-8902df5528ba) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:02 user nova-compute[75258]: INFO os_vif [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d9:84:88,bridge_name='br-int',has_traffic_filtering=True,id=1bab2bf8-d282-4d50-91ff-bc054fc2abc6,network=Network(50771b40-d1fa-4653-9116-486319a534b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1bab2bf8-d2')
Nov 14 12:41:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Deleting instance files /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b_del
Nov 14 12:41:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Deletion of /opt/stack/data/nova/instances/fcb3fb92-cf4c-4258-a498-b768d49c054b_del complete
Nov 14 12:41:02 user nova-compute[75258]: INFO nova.compute.manager [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Took 1.38 seconds to destroy the instance on the hypervisor.
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.part /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.converted" returned: 0 in 0.467s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-3cf0df8b-78f2-4205-b6bc-b65ac22ab5d0 req-8bd741db-5a97-43df-8ff4-58f158f7a0fc service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3cf0df8b-78f2-4205-b6bc-b65ac22ab5d0 req-8bd741db-5a97-43df-8ff4-58f158f7a0fc service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3cf0df8b-78f2-4205-b6bc-b65ac22ab5d0 req-8bd741db-5a97-43df-8ff4-58f158f7a0fc service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3cf0df8b-78f2-4205-b6bc-b65ac22ab5d0 req-8bd741db-5a97-43df-8ff4-58f158f7a0fc service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-3cf0df8b-78f2-4205-b6bc-b65ac22ab5d0 req-8bd741db-5a97-43df-8ff4-58f158f7a0fc service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:02 user nova-compute[75258]: WARNING nova.compute.manager [req-3cf0df8b-78f2-4205-b6bc-b65ac22ab5d0 req-8bd741db-5a97-43df-8ff4-58f158f7a0fc service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state rescuing.
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c.converted --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "1c9e890d089db7bda447341a45e98415b1709f2c" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.817s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "1c9e890d089db7bda447341a45e98415b1709f2c" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "1c9e890d089db7bda447341a45e98415b1709f2c" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-a238d7ed-6137-4b11-a849-c9135bbb3861 req-dd1d575e-aaf4-4947-9b88-98437d19c73b service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received event network-vif-unplugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a238d7ed-6137-4b11-a849-c9135bbb3861 req-dd1d575e-aaf4-4947-9b88-98437d19c73b service nova] Acquiring lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a238d7ed-6137-4b11-a849-c9135bbb3861 req-dd1d575e-aaf4-4947-9b88-98437d19c73b service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a238d7ed-6137-4b11-a849-c9135bbb3861 req-dd1d575e-aaf4-4947-9b88-98437d19c73b service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-a238d7ed-6137-4b11-a849-c9135bbb3861 req-dd1d575e-aaf4-4947-9b88-98437d19c73b service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] No waiting events found dispatching network-vif-unplugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-a238d7ed-6137-4b11-a849-c9135bbb3861 req-dd1d575e-aaf4-4947-9b88-98437d19c73b service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received event network-vif-unplugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c --force-share --output=json" returned: 0 in 0.266s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c,backing_fmt=raw /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c,backing_fmt=raw /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue" returned: 0 in 0.058s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "1c9e890d089db7bda447341a45e98415b1709f2c" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'migration_context' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<5cc80485-d82a-4cf9-856c-6594f6e37c7e> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Start _get_guest_xml network_info=[{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "vif_mac": "fa:16:3e:f4:71:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'd6c38c08-08c5-437b-9e27-c63cbfd71268', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfclQLeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, 'status': 'reserved', 'instance': '5cc80485-d82a-4cf9-856c-6594f6e37c7e', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'serial': 'f6846ab5-9d42-4ade-baa2-ed961c7c0132'}, 'device_type': 'disk', 'attachment_id': 'e39455d0-ed8f-4c98-98eb-66a636fc0191', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'resources' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<5cc80485-d82a-4cf9-856c-6594f6e37c7e> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'numa_topology' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<5cc80485-d82a-4cf9-856c-6594f6e37c7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:41:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<5cc80485-d82a-4cf9-856c-6594f6e37c7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfclQLeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:03 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:03 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:03 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d7784f8-2215-41b4-8722-d1f9250e51eb]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = OfclQLeh\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 12:41:03 user nova-compute[75258]: node.name = iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:41:03 user nova-compute[75258]: node.tpgt = -1
Nov 14 12:41:03 user nova-compute[75258]: node.startup = automatic
Nov 14 12:41:03 user nova-compute[75258]: node.leading_login = No
Nov 14 12:41:03 user nova-compute[75258]: iface.iscsi_ifacename = default
Nov 14 12:41:03 user nova-compute[75258]: iface.net_ifacename = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.ipaddress = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.prefix_len = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.hwaddress = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.transport_name = tcp
Nov 14 12:41:03 user nova-compute[75258]: iface.initiatorname = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.state = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.vlan_id = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.vlan_priority = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.vlan_state = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.iface_num = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.mtu = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.port = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.bootproto = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.subnet_mask = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.gateway = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_alt_client_id = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_dns = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_learn_iqn = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_vendor_id_state = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_vendor_id = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.dhcp_slp_da = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.fragmentation = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.gratuitous_arp = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.incoming_forwarding = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.tos_state = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.tos = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.ttl = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.delayed_ack = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.tcp_nagle = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.tcp_wsf_state = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.tcp_wsf = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.tcp_timer_scale = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.tcp_timestamp = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.redirect = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.def_task_mgmt_timeout = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.header_digest = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.data_digest = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.immediate_data = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.initial_r2t = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.data_seq_inorder = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.data_pdu_inorder = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.erl = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.max_receive_data_len = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.first_burst_len = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.max_outstanding_r2t = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.max_burst_len = 0
Nov 14 12:41:03 user nova-compute[75258]: iface.chap_auth = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.bidi_chap = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.strict_login_compliance = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.discovery_auth = <empty>
Nov 14 12:41:03 user nova-compute[75258]: iface.discovery_logout = <empty>
Nov 14 12:41:03 user nova-compute[75258]: node.discovery_address = <empty>
Nov 14 12:41:03 user nova-compute[75258]: node.discovery_port = 0
Nov 14 12:41:03 user nova-compute[75258]: node.discovery_type = static
Nov 14 12:41:03 user nova-compute[75258]: node.session.initial_cmdsn = 0
Nov 14 12:41:03 user nova-compute[75258]: node.session.initial_login_retry_max = 8
Nov 14 12:41:03 user nova-compute[75258]: node.session.xmit_thread_priority = -20
Nov 14 12:41:03 user nova-compute[75258]: node.session.cmds_max = 128
Nov 14 12:41:03 user nova-compute[75258]: node.session.queue_depth = 32
Nov 14 12:41:03 user nova-compute[75258]: node.session.nr_sessions = 1
Nov 14 12:41:03 user nova-compute[75258]: node.session.auth.authmethod = CHAP
Nov 14 12:41:03 user nova-compute[75258]: node.session.auth.username = OfclQLeh
Nov 14 12:41:03 user nova-compute[75258]: node.session.auth.password = ***
Nov 14 12:41:03 user nova-compute[75258]: node.session.auth.username_in = <empty>
Nov 14 12:41:03 user nova-compute[75258]: node.session.auth.password_in = <empty>
Nov 14 12:41:03 user nova-compute[75258]: node.session.auth.chap_algs = MD5
Nov 14 12:41:03 user nova-compute[75258]: node.session.timeo.replacement_timeout = 120
Nov 14 12:41:03 user nova-compute[75258]: node.session.err_timeo.abort_timeout = 15
Nov 14 12:41:03 user nova-compute[75258]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 12:41:03 user nova-compute[75258]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 12:41:03 user nova-compute[75258]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.FastAbort = Yes
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.InitialR2T = No
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.ImmediateData = Yes
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.MaxConnections = 1
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 12:41:03 user nova-compute[75258]: node.session.iscsi.ERL = 0
Nov 14 12:41:03 user nova-compute[75258]: node.session.scan = manual
Nov 14 12:41:03 user nova-compute[75258]: node.session.reopen_max = 0
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].address = 172.16.0.220
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].port = 3260
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].startup = manual
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].tcp.window_size = 524288
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].tcp.type_of_service = 0
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].timeo.logout_timeout = 15
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].timeo.login_timeout = 15
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].timeo.auth_timeout = 45
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].iscsi.DataDigest = None
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].iscsi.IFMarker = No
Nov 14 12:41:03 user nova-compute[75258]: node.conn[0].iscsi.OFMarker = No
Nov 14 12:41:03 user nova-compute[75258]: # END RECORD
Nov 14 12:41:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.038s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8d5120-b514-48cf-b099-27c72380880a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02220d0e-8369-4cbe-bca9-598588f8d84f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfclQLeh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OfclQLeh" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac76fc98-54c8-4a77-b455-405b460c0c69]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OfclQLeh'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:03 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Took 1.01 seconds to deallocate network for instance.
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f64ef6a6-555f-488c-a5be-826accc5c879]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab37e62b-cc2e-4369-afb7-ab32887e7491]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:03 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:03 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:03 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:03 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.201s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] HCTL ('34', '0', '0', 0) found on session 12 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Scanning host 34 c: 0, t: 0, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3256cea8-6bd2-4b6b-a5dc-7c7575d50a94]: (4, ('0 0 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching for a device in session 12 and hctl ('34', '0', '0', 0) yield: sdc {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfclQLeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.234s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== connect_volume: return (236ms) {'type': 'block', 'scsi_wwn': '23066663766383734', 'path': '/dev/sdc'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23066663766383734', 'path': '/dev/sdc'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1141644014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1141644014',id=13,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:39:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-vrhvg0r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:39:28Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=5cc80485-d82a-4cf9-856c-6594f6e37c7e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "vif_mac": "fa:16:3e:f4:71:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "vif_mac": "fa:16:3e:f4:71:6f"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'pci_devices' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<5cc80485-d82a-4cf9-856c-6594f6e37c7e> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:41:03 user nova-compute[75258]:   <uuid>5cc80485-d82a-4cf9-856c-6594f6e37c7e</uuid>
Nov 14 12:41:03 user nova-compute[75258]:   <name>instance-0000000d</name>
Nov 14 12:41:03 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:41:03 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:41:03 user nova-compute[75258]:   <metadata>
Nov 14 12:41:03 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:41:03 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:41:03 user nova-compute[75258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1141644014</nova:name>
Nov 14 12:41:03 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:41:03</nova:creationTime>
Nov 14 12:41:03 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:41:03 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:41:03 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:41:03 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:41:03 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:41:03 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:41:03 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:41:03 user nova-compute[75258]:       <nova:owner>
Nov 14 12:41:03 user nova-compute[75258]:         <nova:user uuid="cef85161135e4a978dd763ae91809be9">tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member</nova:user>
Nov 14 12:41:03 user nova-compute[75258]:         <nova:project uuid="c593ba588c7f442689362cda037f95f8">tempest-ServerBootFromVolumeStableRescueTest-1735756414</nova:project>
Nov 14 12:41:03 user nova-compute[75258]:       </nova:owner>
Nov 14 12:41:03 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:41:03 user nova-compute[75258]:       <nova:ports>
Nov 14 12:41:03 user nova-compute[75258]:         <nova:port uuid="12b52550-1a48-42c6-bd83-4241dd9e7e4e">
Nov 14 12:41:03 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:41:03 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:03 user nova-compute[75258]:       </nova:ports>
Nov 14 12:41:03 user nova-compute[75258]:     </nova:instance>
Nov 14 12:41:03 user nova-compute[75258]:   </metadata>
Nov 14 12:41:03 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:41:03 user nova-compute[75258]:     <system>
Nov 14 12:41:03 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:41:03 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:41:03 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:41:03 user nova-compute[75258]:       <entry name="serial">5cc80485-d82a-4cf9-856c-6594f6e37c7e</entry>
Nov 14 12:41:03 user nova-compute[75258]:       <entry name="uuid">5cc80485-d82a-4cf9-856c-6594f6e37c7e</entry>
Nov 14 12:41:03 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:41:03 user nova-compute[75258]:     </system>
Nov 14 12:41:03 user nova-compute[75258]:   </sysinfo>
Nov 14 12:41:03 user nova-compute[75258]:   <os>
Nov 14 12:41:03 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:41:03 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:41:03 user nova-compute[75258]:   </os>
Nov 14 12:41:03 user nova-compute[75258]:   <features>
Nov 14 12:41:03 user nova-compute[75258]:     <acpi/>
Nov 14 12:41:03 user nova-compute[75258]:     <apic/>
Nov 14 12:41:03 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:41:03 user nova-compute[75258]:   </features>
Nov 14 12:41:03 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:41:03 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:41:03 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:41:03 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:41:03 user nova-compute[75258]:   </clock>
Nov 14 12:41:03 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:41:03 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:41:03 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:41:03 user nova-compute[75258]:   </cpu>
Nov 14 12:41:03 user nova-compute[75258]:   <devices>
Nov 14 12:41:03 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:41:03 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:03 user nova-compute[75258]:       <source dev="/dev/sdc"/>
Nov 14 12:41:03 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:41:03 user nova-compute[75258]:       <serial>f6846ab5-9d42-4ade-baa2-ed961c7c0132</serial>
Nov 14 12:41:03 user nova-compute[75258]:     </disk>
Nov 14 12:41:03 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:41:03 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:41:03 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue"/>
Nov 14 12:41:03 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:41:03 user nova-compute[75258]:       <boot order="1"/>
Nov 14 12:41:03 user nova-compute[75258]:     </disk>
Nov 14 12:41:03 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:03 user nova-compute[75258]:       <mac address="fa:16:3e:f4:71:6f"/>
Nov 14 12:41:03 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:03 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:03 user nova-compute[75258]:       <target dev="tap12b52550-1a"/>
Nov 14 12:41:03 user nova-compute[75258]:     </interface>
Nov 14 12:41:03 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:41:03 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/console.log" append="off"/>
Nov 14 12:41:03 user nova-compute[75258]:     </serial>
Nov 14 12:41:03 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:41:03 user nova-compute[75258]:     <video>
Nov 14 12:41:03 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:03 user nova-compute[75258]:     </video>
Nov 14 12:41:03 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:41:03 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:41:03 user nova-compute[75258]:     </rng>
Nov 14 12:41:03 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:41:03 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:41:03 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:41:03 user nova-compute[75258]:     </memballoon>
Nov 14 12:41:03 user nova-compute[75258]:   </devices>
Nov 14 12:41:03 user nova-compute[75258]: </domain>
Nov 14 12:41:03 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:41:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance destroyed successfully.
Nov 14 12:41:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:41:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No VIF found with MAC fa:16:3e:f4:71:6f, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.400s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:04 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Deleted allocations for instance fcb3fb92-cf4c-4258-a498-b768d49c054b
Nov 14 12:41:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cbdbd936-a16f-4006-9997-747597f084e5 tempest-VolumesActionsTest-1666751966 tempest-VolumesActionsTest-1666751966-project-member] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.089s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-1dabf029-2650-4237-871c-8104715115ae req-4c698518-d0ab-4744-a1da-b9f6bf65f735 service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received event network-vif-deleted-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:04 user nova-compute[75258]: INFO nova.compute.manager [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attaching volume 60c4f493-f76f-4daf-a0b8-4e25135342b3 to /dev/vdb
Nov 14 12:41:05 user nova-compute[75258]: DEBUG os_brick.utils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfe934f9-59df-46bb-a7e9-b0fbed34a577]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e95a378-51da-4350-81cd-13bce0236e3f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c22543d5-6ef1-4b4b-9f17-532d18d8e20e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a191f8b4-01e2-4bf0-bce0-fd7cfccd5e35]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:05 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e9abd8-d10a-4104-9e4b-eaf5f12f28d1]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG os_brick.utils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating existing volume attachment record: 6e533c19-c295-4c70-b2a5-80a9806756a1 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-73852537-a800-442d-9008-6b8afdcd42b1 req-6b931d83-9610-404f-aa62-d15b5c1c192a service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received event network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73852537-a800-442d-9008-6b8afdcd42b1 req-6b931d83-9610-404f-aa62-d15b5c1c192a service nova] Acquiring lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73852537-a800-442d-9008-6b8afdcd42b1 req-6b931d83-9610-404f-aa62-d15b5c1c192a service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73852537-a800-442d-9008-6b8afdcd42b1 req-6b931d83-9610-404f-aa62-d15b5c1c192a service nova] Lock "fcb3fb92-cf4c-4258-a498-b768d49c054b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-73852537-a800-442d-9008-6b8afdcd42b1 req-6b931d83-9610-404f-aa62-d15b5c1c192a service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] No waiting events found dispatching network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:05 user nova-compute[75258]: WARNING nova.compute.manager [req-73852537-a800-442d-9008-6b8afdcd42b1 req-6b931d83-9610-404f-aa62-d15b5c1c192a service nova] [instance: fcb3fb92-cf4c-4258-a498-b768d49c054b] Received unexpected event network-vif-plugged-1bab2bf8-d282-4d50-91ff-bc054fc2abc6 for instance with vm_state deleted and task_state None.
Nov 14 12:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:41:06 user nova-compute[75258]: INFO nova.compute.claims [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Claim successful on node user
Nov 14 12:41:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:06 user nova-compute[75258]: WARNING nova.compute.manager [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state rescuing.
Nov 14 12:41:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:06 user nova-compute[75258]: WARNING nova.compute.manager [req-a5afd889-6b1c-41af-b596-40650d2a95b1 req-6705cf3b-edc0-4c67-9de3-4ae1e067ebf5 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state rescuing.
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.662s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.network.neutron [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:41:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-27066975-80b8-491f-b929-0d4b667b9b8e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.policy [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '873cb2d85dba423c89f8a4fd99377a14', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3597e92033a4fedafa79d98540cc451', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:41:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Creating image(s)
Nov 14 12:41:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk 1073741824" returned: 0 in 0.063s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.274s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Successfully created port: f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.213s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Cannot resize image /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Ensure instance console log exists: /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Successfully updated port: f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-changed-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Refreshing instance network info cache due to event network-changed-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance network_info: |[{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.neutron [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Refreshing network info cache for port f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Start _get_guest_xml network_info=[{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:41:09 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:09 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.objects.instance [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lazy-loading 'pci_devices' on Instance uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:41:09 user nova-compute[75258]:   <uuid>675b780c-92f9-41de-9457-ae035af15eeb</uuid>
Nov 14 12:41:09 user nova-compute[75258]:   <name>instance-00000013</name>
Nov 14 12:41:09 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:41:09 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:41:09 user nova-compute[75258]:   <metadata>
Nov 14 12:41:09 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:41:09 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:41:09 user nova-compute[75258]:       <nova:name>tempest-ServerActionsTestOtherB-server-112003904</nova:name>
Nov 14 12:41:09 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:41:09</nova:creationTime>
Nov 14 12:41:09 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:41:09 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:41:09 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:41:09 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:41:09 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:41:09 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:41:09 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:41:09 user nova-compute[75258]:       <nova:owner>
Nov 14 12:41:09 user nova-compute[75258]:         <nova:user uuid="873cb2d85dba423c89f8a4fd99377a14">tempest-ServerActionsTestOtherB-1658255901-project-member</nova:user>
Nov 14 12:41:09 user nova-compute[75258]:         <nova:project uuid="e3597e92033a4fedafa79d98540cc451">tempest-ServerActionsTestOtherB-1658255901</nova:project>
Nov 14 12:41:09 user nova-compute[75258]:       </nova:owner>
Nov 14 12:41:09 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:41:09 user nova-compute[75258]:       <nova:ports>
Nov 14 12:41:09 user nova-compute[75258]:         <nova:port uuid="f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40">
Nov 14 12:41:09 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 12:41:09 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:09 user nova-compute[75258]:       </nova:ports>
Nov 14 12:41:09 user nova-compute[75258]:     </nova:instance>
Nov 14 12:41:09 user nova-compute[75258]:   </metadata>
Nov 14 12:41:09 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:41:09 user nova-compute[75258]:     <system>
Nov 14 12:41:09 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:41:09 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:41:09 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:41:09 user nova-compute[75258]:       <entry name="serial">675b780c-92f9-41de-9457-ae035af15eeb</entry>
Nov 14 12:41:09 user nova-compute[75258]:       <entry name="uuid">675b780c-92f9-41de-9457-ae035af15eeb</entry>
Nov 14 12:41:09 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:41:09 user nova-compute[75258]:     </system>
Nov 14 12:41:09 user nova-compute[75258]:   </sysinfo>
Nov 14 12:41:09 user nova-compute[75258]:   <os>
Nov 14 12:41:09 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:41:09 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:41:09 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:41:09 user nova-compute[75258]:   </os>
Nov 14 12:41:09 user nova-compute[75258]:   <features>
Nov 14 12:41:09 user nova-compute[75258]:     <acpi/>
Nov 14 12:41:09 user nova-compute[75258]:     <apic/>
Nov 14 12:41:09 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:41:09 user nova-compute[75258]:   </features>
Nov 14 12:41:09 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:41:09 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:41:09 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:41:09 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:41:09 user nova-compute[75258]:   </clock>
Nov 14 12:41:09 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:41:09 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:41:09 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:41:09 user nova-compute[75258]:   </cpu>
Nov 14 12:41:09 user nova-compute[75258]:   <devices>
Nov 14 12:41:09 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:41:09 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:41:09 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk"/>
Nov 14 12:41:09 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:41:09 user nova-compute[75258]:     </disk>
Nov 14 12:41:09 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:09 user nova-compute[75258]:       <mac address="fa:16:3e:42:82:58"/>
Nov 14 12:41:09 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:09 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:09 user nova-compute[75258]:       <target dev="tapf9fe5608-d5"/>
Nov 14 12:41:09 user nova-compute[75258]:     </interface>
Nov 14 12:41:09 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:41:09 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/console.log" append="off"/>
Nov 14 12:41:09 user nova-compute[75258]:     </serial>
Nov 14 12:41:09 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:41:09 user nova-compute[75258]:     <video>
Nov 14 12:41:09 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:09 user nova-compute[75258]:     </video>
Nov 14 12:41:09 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:41:09 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:41:09 user nova-compute[75258]:     </rng>
Nov 14 12:41:09 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:41:09 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:41:09 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:41:09 user nova-compute[75258]:     </memballoon>
Nov 14 12:41:09 user nova-compute[75258]:   </devices>
Nov 14 12:41:09 user nova-compute[75258]: </domain>
Nov 14 12:41:09 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG os_vif [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5093c991-1bb6-58ee-b068-3f8e246cbdf1', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fe5608-d5, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9fe5608-d5, col_values=(('qos', UUID('9404c481-55c8-4b9b-95b3-bcb02e4f306e')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9fe5608-d5, col_values=(('external_ids', {'iface-id': 'f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:82:58', 'vm-uuid': '675b780c-92f9-41de-9457-ae035af15eeb'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:09 user nova-compute[75258]: INFO os_vif [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5')
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:41:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No VIF found with MAC fa:16:3e:42:82:58, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjnoGldk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:10 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:10 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:10 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6cdc772-f392-4aae-9e12-2dd6536eae81]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:41:10 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[605c6fab-7c9d-4392-91f1-3fe1f357188f]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3] added
Nov 14 12:41:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[15388985-447a-4833-8582-5bf78120ff3e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14300a6-3883-4cf9-8dbf-d6ee9b849391]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjnoGldk {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pjnoGldk" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[29607362-8a43-4104-bbdc-9f06f41a97ea]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pjnoGldk'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 4cd80282-24f6-4b44-bb13-f9586d478364 is timed out.
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba20189-a461-43a1-b9ea-db5a917dc292]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Successfully detached device vdb from instance 4cd80282-24f6-4b44-bb13-f9586d478364 from the live domain config.
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gakQfJwM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:10 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[55760f28-ff20-44c5-ade4-25fbca3c845d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updated VIF entry in instance network info cache for port f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-11381c81-a2c8-4e47-bdda-26af1524cc54 req-357bceb9-b4f1-4b27-9173-f67af34df40e service nova] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf75fb1e-4670-4d31-bc88-93d9623d31a1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260]
Nov 14 12:41:10 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260] successful.
Nov 14 12:41:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55c44d6-8e44-4bbd-ab4f-9d2095fe7b71]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d9407c-7d40-4269-adf3-b77d01113248]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)
Nov 14 12:41:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.351s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] HCTL ('35', '-', '-', 0) found on session 18 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d684bb3a-97c0-440d-9e77-7ec9661bbbb8]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Searching for a device in session 18 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:41:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjnoGldk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '23361643865653165', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361643865653165', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 1.205s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3944a43b-5c28-4492-ab19-014e656ac978]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:41:11 user nova-compute[75258]: No targets found.
Nov 14 12:41:11 user nova-compute[75258]: iSNS:
Nov 14 12:41:11 user nova-compute[75258]: No targets found.
Nov 14 12:41:11 user nova-compute[75258]: STATIC:
Nov 14 12:41:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:41:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:41:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:41:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:41:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:41:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:41:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b
Nov 14 12:41:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:41:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:41:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3
Nov 14 12:41:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:41:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:41:11 user nova-compute[75258]: FIRMWARE:
Nov 14 12:41:11 user nova-compute[75258]: No targets found.
Nov 14 12:41:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:41:11 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:41:11 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc12f5c3-a5bc-4130-8b79-ad45f48b6d51]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:41:11 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:11 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:41:11 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:41:11 user nova-compute[75258]:   <serial>60c4f493-f76f-4daf-a0b8-4e25135342b3</serial>
Nov 14 12:41:11 user nova-compute[75258]: </disk>
Nov 14 12:41:11 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1faaed18-cf96-4a62-881a-f0fdfa4c8054]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:11 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:11 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:11 user nova-compute[75258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)
Nov 14 12:41:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:11 user nova-compute[75258]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b (non-flash)
Nov 14 12:41:11 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:11 user nova-compute[75258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)
Nov 14 12:41:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c609e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f753be8c-6020-4aea-b92a-86112e6b3d7f]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[021f7151-77e2-4784-9a34-90ee6a5e11b4]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f805206b-6d07-4fd5-ae71-c089cc4561f5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-ba584486-48e5-4c72-baf9-466c5a28cd96 req-26c30e89-c535-4abd-b0f3-ec5b932c3d1b service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ba584486-48e5-4c72-baf9-466c5a28cd96 req-26c30e89-c535-4abd-b0f3-ec5b932c3d1b service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ba584486-48e5-4c72-baf9-466c5a28cd96 req-26c30e89-c535-4abd-b0f3-ec5b932c3d1b service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ba584486-48e5-4c72-baf9-466c5a28cd96 req-26c30e89-c535-4abd-b0f3-ec5b932c3d1b service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-ba584486-48e5-4c72-baf9-466c5a28cd96 req-26c30e89-c535-4abd-b0f3-ec5b932c3d1b service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:11 user nova-compute[75258]: WARNING nova.compute.manager [req-ba584486-48e5-4c72-baf9-466c5a28cd96 req-26c30e89-c535-4abd-b0f3-ec5b932c3d1b service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state building and task_state spawning.
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0cf981-7b3b-46b9-9ecd-8b8f19113095]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e3c433-4b09-4704-957b-0258770b4ddf]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[15b82972-53cc-4a8f-a6a7-dd16fa025eed]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260]
Nov 14 12:41:11 user nova-compute[75258]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b, portal: 172.16.0.220,3260] successful.
Nov 14 12:41:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:432ad3bd-37ce-445a-9b4e-7ab1a40ce96b -p 172.16.0.220:3260 --op delete" returned: 0 in 0.039s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc46de2-6996-471c-8f53-6c4bad3ed932]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.464s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] <== disconnect_volume: return (1670ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No VIF found with MAC fa:16:3e:e8:ff:7e, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9c5cde50-32ea-4108-aadf-db99acfb6ecb tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.492s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:12 user nova-compute[75258]: INFO nova.compute.manager [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Terminating instance
Nov 14 12:41:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG nova.objects.instance [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'flavor' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1da7aba1-676c-4f63-b6f0-aba1ced03a09 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 23.342s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:13 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Instance destroyed successfully.
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lazy-loading 'resources' on Instance uuid eab53582-4a5b-4edd-bb16-c028d3abf7f7 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-237890098',display_name='tempest-VolumesAdminNegativeTest-server-237890098',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-237890098',id=15,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:39:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5b09a067539485181c0bd2f6edb4651',ramdisk_id='',reservation_id='r-ow2p84an',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-746118338',owner_user_name='tempest-VolumesAdminNegativeTest-746118338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:39:25Z,user_data=None,user_id='61b84b06ec4247bca42431850be2d0c7',uuid=eab53582-4a5b-4edd-bb16-c028d3abf7f7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converting VIF {"id": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "address": "fa:16:3e:69:52:89", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa22bab8f-78", "ovs_interfaceid": "a22bab8f-7858-4cc1-96f5-90cb6f9afcfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:52:89,bridge_name='br-int',has_traffic_filtering=True,id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22bab8f-78') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG os_vif [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:52:89,bridge_name='br-int',has_traffic_filtering=True,id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22bab8f-78') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa22bab8f-78, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=0b4df576-4140-4b19-9f8f-72e9ddd26d5a) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:13 user nova-compute[75258]: INFO os_vif [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:52:89,bridge_name='br-int',has_traffic_filtering=True,id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa22bab8f-78')
Nov 14 12:41:13 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Deleting instance files /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7_del
Nov 14 12:41:13 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Deletion of /opt/stack/data/nova/instances/eab53582-4a5b-4edd-bb16-c028d3abf7f7_del complete
Nov 14 12:41:13 user nova-compute[75258]: INFO nova.compute.manager [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Took 0.97 seconds to destroy the instance on the hypervisor.
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:13 user nova-compute[75258]: WARNING nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state building and task_state spawning.
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received event network-vif-unplugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Acquiring lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] No waiting events found dispatching network-vif-unplugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received event network-vif-unplugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received event network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Acquiring lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] No waiting events found dispatching network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:13 user nova-compute[75258]: WARNING nova.compute.manager [req-b636fde0-33f4-4a0a-bb99-048520b2882b req-5e26df9b-ca4d-438c-a6dd-0e6a28719321 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received unexpected event network-vif-plugged-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe for instance with vm_state active and task_state deleting.
Nov 14 12:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:14 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Took 0.74 seconds to deallocate network for instance.
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-af45ac2f-a8ac-4f53-8df2-6d2266e68fff req-413f3902-8f64-4a4e-bcfa-4642818b9785 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Received event network-vif-deleted-a22bab8f-7858-4cc1-96f5-90cb6f9afcfe {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:14 user nova-compute[75258]: INFO nova.compute.manager [req-af45ac2f-a8ac-4f53-8df2-6d2266e68fff req-413f3902-8f64-4a4e-bcfa-4642818b9785 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Neutron deleted interface a22bab8f-7858-4cc1-96f5-90cb6f9afcfe; detaching it from the instance and deleting it from the info cache
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.network.neutron [req-af45ac2f-a8ac-4f53-8df2-6d2266e68fff req-413f3902-8f64-4a4e-bcfa-4642818b9785 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-af45ac2f-a8ac-4f53-8df2-6d2266e68fff req-413f3902-8f64-4a4e-bcfa-4642818b9785 service nova] [instance: eab53582-4a5b-4edd-bb16-c028d3abf7f7] Detach interface failed, port_id=a22bab8f-7858-4cc1-96f5-90cb6f9afcfe, reason: Instance eab53582-4a5b-4edd-bb16-c028d3abf7f7 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:14 user nova-compute[75258]: INFO nova.compute.manager [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Detaching volume 60c4f493-f76f-4daf-a0b8-4e25135342b3
Nov 14 12:41:14 user nova-compute[75258]: INFO nova.virt.block_device [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attempting to driver detach volume 60c4f493-f76f-4daf-a0b8-4e25135342b3 from mountpoint /dev/vdb
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Attempting to detach device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:41:14 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:14 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:41:14 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:41:14 user nova-compute[75258]:   <serial>60c4f493-f76f-4daf-a0b8-4e25135342b3</serial>
Nov 14 12:41:14 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:41:14 user nova-compute[75258]: </disk>
Nov 14 12:41:14 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:41:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config.
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:41:14 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:14 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:41:14 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:41:14 user nova-compute[75258]:   <serial>60c4f493-f76f-4daf-a0b8-4e25135342b3</serial>
Nov 14 12:41:14 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:41:14 user nova-compute[75258]: </disk>
Nov 14 12:41:14 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:41:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance spawned successfully.
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.542s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:14 user nova-compute[75258]: INFO nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Took 7.05 seconds to spawn the instance on the hypervisor.
Nov 14 12:41:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "20460ef8-3184-40a3-9778-99a570da24f3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:15 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Deleted allocations for instance eab53582-4a5b-4edd-bb16-c028d3abf7f7
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:41:15 user nova-compute[75258]: INFO nova.compute.manager [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Took 8.28 seconds to build instance.
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6afa6853-200f-45b2-a9a8-cad13916d57b tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "eab53582-4a5b-4edd-bb16-c028d3abf7f7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.524s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-60b6741e-dd6b-4b17-b4df-db934c3c4628 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.398s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:41:15 user nova-compute[75258]: INFO nova.compute.claims [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Claim successful on node user
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.481s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:41:15 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:41:15 user nova-compute[75258]: INFO nova.virt.block_device [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Booting with volume cac3e17d-4dab-44a8-a88a-572c7a82544a at /dev/vda
Nov 14 12:41:15 user nova-compute[75258]: DEBUG os_brick.utils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[228b0d95-2919-400b-b397-36de4cc64129]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[541c140d-c77f-4f83-9761-2a490caed5a7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG nova.policy [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '73d464847a1f44e38f112a5f6463abaf', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '944aa8964e2d495cafdaf0eef5b61861', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f67f50d-955d-4023-9981-905852720c90]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cea93ae-e952-4a4f-a890-7959d31fadb6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:16 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:41:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5472cc39-c027-4ae2-af09-5a22c68664be]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG os_brick.utils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating existing volume attachment record: 3ce95887-5f3a-4149-97a2-4e283101ae25 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:41:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully created port: 7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "50b47c33-9bbb-48f5-b695-11c2986a458a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:17 user nova-compute[75258]: INFO nova.compute.manager [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Terminating instance
Nov 14 12:41:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully created port: 2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-bcd75770-3b4a-4aaf-b5da-08299c7191d4 req-0ceef6b2-6b92-4900-9305-83f1ed6b4dba service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received event network-vif-unplugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bcd75770-3b4a-4aaf-b5da-08299c7191d4 req-0ceef6b2-6b92-4900-9305-83f1ed6b4dba service nova] Acquiring lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bcd75770-3b4a-4aaf-b5da-08299c7191d4 req-0ceef6b2-6b92-4900-9305-83f1ed6b4dba service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bcd75770-3b4a-4aaf-b5da-08299c7191d4 req-0ceef6b2-6b92-4900-9305-83f1ed6b4dba service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-bcd75770-3b4a-4aaf-b5da-08299c7191d4 req-0ceef6b2-6b92-4900-9305-83f1ed6b4dba service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] No waiting events found dispatching network-vif-unplugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-bcd75770-3b4a-4aaf-b5da-08299c7191d4 req-0ceef6b2-6b92-4900-9305-83f1ed6b4dba service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received event network-vif-unplugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:41:17 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Instance destroyed successfully.
Nov 14 12:41:17 user nova-compute[75258]: DEBUG nova.objects.instance [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lazy-loading 'resources' on Instance uuid 50b47c33-9bbb-48f5-b695-11c2986a458a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:26Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-23199992',display_name='tempest-VolumesNegativeTest-instance-23199992',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-23199992',id=16,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:39:33Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='66786a4505824b018e8f4c0e37141d31',ramdisk_id='',reservation_id='r-n74tpyf4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-244840624',owner_user_name='tempest-VolumesNegativeTest-244840624-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:39:34Z,user_data=None,user_id='504c8651c03d47f399cbdfe0755ff396',uuid=50b47c33-9bbb-48f5-b695-11c2986a458a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Converting VIF {"id": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "address": "fa:16:3e:fc:7b:c9", "network": {"id": "3969c1ba-fd91-42e5-8bad-52610bdb7bd2", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "e9df3caeab9442b7b1d26e5e1a6df527", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd7cfdd8f-77", "ovs_interfaceid": "d7cfdd8f-7746-4b0f-a2fb-126a26e73f22", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=d7cfdd8f-7746-4b0f-a2fb-126a26e73f22,network=Network(3969c1ba-fd91-42e5-8bad-52610bdb7bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cfdd8f-77') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG os_vif [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=d7cfdd8f-7746-4b0f-a2fb-126a26e73f22,network=Network(3969c1ba-fd91-42e5-8bad-52610bdb7bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cfdd8f-77') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd7cfdd8f-77, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=67b6ff85-c534-4636-b995-30af03d0c19b) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:18 user nova-compute[75258]: INFO os_vif [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:7b:c9,bridge_name='br-int',has_traffic_filtering=True,id=d7cfdd8f-7746-4b0f-a2fb-126a26e73f22,network=Network(3969c1ba-fd91-42e5-8bad-52610bdb7bd2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd7cfdd8f-77')
Nov 14 12:41:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Deleting instance files /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a_del
Nov 14 12:41:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Deletion of /opt/stack/data/nova/instances/50b47c33-9bbb-48f5-b695-11c2986a458a_del complete
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully created port: e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:41:18 user nova-compute[75258]: INFO nova.compute.manager [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:18 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Took 0.61 seconds to deallocate network for instance.
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully created port: 0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-2950f30d-6b0b-455e-8e95-e5c154666964 req-ae87f3f1-ee75-4002-902a-975375f15aad service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received event network-vif-deleted-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json" returned: 0 in 0.231s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.552s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:19 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Deleted allocations for instance 50b47c33-9bbb-48f5-b695-11c2986a458a
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully created port: a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-869a82de-249a-4aac-831f-eeaa2ebe1b6f tempest-VolumesNegativeTest-244840624 tempest-VolumesNegativeTest-244840624-project-member] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.548s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG nova.compute.manager [req-8741e1db-ce99-4325-91e6-f570b9a2370e req-184026c9-1f23-4605-b8eb-6a46d5e7396c service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received event network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8741e1db-ce99-4325-91e6-f570b9a2370e req-184026c9-1f23-4605-b8eb-6a46d5e7396c service nova] Acquiring lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8741e1db-ce99-4325-91e6-f570b9a2370e req-184026c9-1f23-4605-b8eb-6a46d5e7396c service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8741e1db-ce99-4325-91e6-f570b9a2370e req-184026c9-1f23-4605-b8eb-6a46d5e7396c service nova] Lock "50b47c33-9bbb-48f5-b695-11c2986a458a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG nova.compute.manager [req-8741e1db-ce99-4325-91e6-f570b9a2370e req-184026c9-1f23-4605-b8eb-6a46d5e7396c service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] No waiting events found dispatching network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:19 user nova-compute[75258]: WARNING nova.compute.manager [req-8741e1db-ce99-4325-91e6-f570b9a2370e req-184026c9-1f23-4605-b8eb-6a46d5e7396c service nova] [instance: 50b47c33-9bbb-48f5-b695-11c2986a458a] Received unexpected event network-vif-plugged-d7cfdd8f-7746-4b0f-a2fb-126a26e73f22 for instance with vm_state deleted and task_state None.
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully updated port: 7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-7e00c907-5dd9-4bd6-b39d-301b32d2db1d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG nova.network.neutron [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port 7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG nova.network.neutron [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG nova.network.neutron [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd50c854-0bb2-407f-b6b2-54aae4a3c161 req-6dd8b3d8-157e-4e1d-807b-a2d0de7e7c8c service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully updated port: 44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364/disk --force-share --output=json" returned: 0 in 0.327s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.212s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.229s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully updated port: 154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.205s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-44cc718e-41e3-4891-96b9-345e3c3c9a10. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port 44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully updated port: 2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-154ae39d-bfc2-411f-98a9-9f4f5495fc2a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port 154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.network.neutron [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:41:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7583MB free_disk=25.307403564453125GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3121053b-59aa-4412-aee7-a4b54d99d50d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4cd80282-24f6-4b44-bb13-f9586d478364 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 10574d06-4168-43c2-bf6b-22a1a55febab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 20460ef8-3184-40a3-9778-99a570da24f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.network.neutron [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully updated port: e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a8f776dd-0e34-4331-be23-aba9867aee1e req-ce1244a7-0a73-4c8b-b32b-a8627fe9af02 service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:41:24 user nova-compute[75258]: INFO nova.virt.block_device [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Booting with volume 2569e17f-4313-4d2f-90ff-e347f42bcc80 at /dev/vdb
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.683s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG os_brick.utils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8ca028d-cafd-42a6-8e24-69c3e23511a8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78124215-03a0-4aae-9c68-2aa2d91240db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9604b5a-ade3-4e08-8399-55e73df41bba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[282f40a5-a864-4e80-bcbf-d6642f949568]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:24 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a96d184-a47d-46da-8477-ce6338a5d5ef]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG os_brick.utils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating existing volume attachment record: f72099c7-7780-4e88-ba92-e406743b6ca7 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-2feaa2c6-358f-4218-b9e7-cd675102b831. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port 2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully updated port: 0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:41:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-229fe337-9c7d-4591-a768-8ef680431ff5 req-8cd5a2c1-c81a-4705-be3c-fefc5b7c22e3 service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Successfully updated port: a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:41:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:41:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:41:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-0914c675-6bf9-48cd-8ab0-f2426ffda9c7. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [{"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance network_info: |[{"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port 0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updated VIF entry in instance network info cache for port 0914c675-6bf9-48cd-8ab0-f2426ffda9c7. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [{"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-a775c9a7-fe67-46da-be05-32d36f2c71f9. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:41:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:41:28 user nova-compute[75258]: DEBUG nova.network.neutron [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updated VIF entry in instance network info cache for port a775c9a7-fe67-46da-be05-32d36f2c71f9. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:41:28 user nova-compute[75258]: DEBUG nova.network.neutron [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [{"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d4e5033e-d741-42f3-99f3-319681a6900c req-d91c4f68-5695-46c6-9553-36908e07908b service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:41:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:30 user nova-compute[75258]: INFO nova.virt.block_device [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Booting with volume ffa8f0a2-7773-4cee-9572-9abf40acf10a at /dev/vdc
Nov 14 12:41:30 user nova-compute[75258]: DEBUG os_brick.utils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf17b911-1002-460a-8cac-5d20a00d5be7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4015d65f-8fae-4c1a-b81a-546a62f9795e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89bf878-1968-4ccd-b95f-fb8546e68120]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8170e8a-d9d3-4dcd-a15f-597ba3d8c515]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:41:30 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:41:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[953a1157-51b4-43b4-977d-136cc3f0c56b]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG os_brick.utils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:30 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating existing volume attachment record: 038997e5-f454-4264-bf38-abd4b0916614 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:41:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 is timed out.
Nov 14 12:41:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config.
Nov 14 12:41:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pjnoGldk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:35 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f17e31cc-f254-429f-91a4-8ceb08aeeb23]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:41:35 user nova-compute[75258]: No targets found.
Nov 14 12:41:35 user nova-compute[75258]: iSNS:
Nov 14 12:41:35 user nova-compute[75258]: No targets found.
Nov 14 12:41:35 user nova-compute[75258]: STATIC:
Nov 14 12:41:35 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:41:35 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:41:35 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:41:35 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:41:35 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:41:35 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:41:35 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3
Nov 14 12:41:35 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:41:35 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:41:35 user nova-compute[75258]: FIRMWARE:
Nov 14 12:41:35 user nova-compute[75258]: No targets found.
Nov 14 12:41:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:41:35 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:41:35 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[637764cf-cd92-4cc6-bb35-f277f435929e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8683b083-e4a0-4b13-a2f7-63ef26b385f4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:35 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:35 user nova-compute[75258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)
Nov 14 12:41:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:35 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:35 user nova-compute[75258]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 (non-flash)
Nov 14 12:41:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c64a290>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[882a1452-8b0d-438a-802d-ebb9ccda5c1e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d587185-0c02-4e46-8389-0b7f29b2d5df]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bc3b61-3110-4a52-8098-e46157b31388]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b70b1f-a730-4c5b-ac1e-43bd0bbf3c6b]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c255a650-7fce-48c4-b66f-3dbaec7a5107]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa9c720-639c-4b14-a0e9-0f37b4d48559]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260]
Nov 14 12:41:35 user nova-compute[75258]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3, portal: 172.16.0.220,3260] successful.
Nov 14 12:41:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:60c4f493-f76f-4daf-a0b8-4e25135342b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24f65a5c-df70-4a5d-9072-cf58638d0937]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== disconnect_volume: return (309ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:41:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-be437907-84cb-40a4-b471-926df8b66d91 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.815s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:41:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Creating image(s)
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Ensure instance console log exists: /opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Start _get_guest_xml network_info=[{"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHhGOugF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20460ef8-3184-40a3-9778-99a570da24f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'cac3e17d-4dab-44a8-a88a-572c7a82544a', 'serial': 'cac3e17d-4dab-44a8-a88a-572c7a82544a'}, 'device_type': 'disk', 'attachment_id': '3ce95887-5f3a-4149-97a2-4e283101ae25', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuEOdZsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20460ef8-3184-40a3-9778-99a570da24f3', 'attached_at': '', 'detached_at': '', 'volume_id': '2569e17f-4313-4d2f-90ff-e347f42bcc80', 'serial': '2569e17f-4313-4d2f-90ff-e347f42bcc80'}, 'device_type': 'disk', 'attachment_id': 'f72099c7-7780-4e88-ba92-e406743b6ca7', 'boot_index': 1, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfiPSukC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '20460ef8-3184-40a3-9778-99a570da24f3', 'attached_at': '', 'detached_at': '', 'volume_id': 'ffa8f0a2-7773-4cee-9572-9abf40acf10a', 'serial': 'ffa8f0a2-7773-4cee-9572-9abf40acf10a'}, 'device_type': 'disk', 'attachment_id': '038997e5-f454-4264-bf38-abd4b0916614', 'boot_index': 2, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:41:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHhGOugF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:37 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:37 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:37 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b778ed6d-e4e9-40ef-b50f-48cb415a8ab8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:41:37 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32c06ab-3a1f-4878-86ef-d2c6b6a36262]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a] added
Nov 14 12:41:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[742b0215-8578-41c6-a2b9-df6c44600d51]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[986651a1-9c77-471a-8052-ce16d50ed3f5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHhGOugF {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QHhGOugF" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4afba12d-a0ee-48b3-8243-5342564e1a76]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QHhGOugF'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5cd9f06-55d7-4316-a61f-0c948b40ccea]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f083920f-738c-46f6-b470-ffdad7f3692f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b5fee8-38f3-4621-9621-3be1d71f1142]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260]
Nov 14 12:41:37 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260] successful.
Nov 14 12:41:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9be02e0d-5f33-4bc3-a627-79ffca015459]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fb63a45-7cc3-44fd-93f7-e6f39dd95f0a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:37 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] HCTL ('33', '-', '-', 0) found on session 19 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2a8c814-f658-4dd3-b822-8a7c8462c341]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Searching for a device in session 19 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:41:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHhGOugF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.308s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== connect_volume: return (1309ms) {'type': 'block', 'scsi_wwn': '26366663936323064', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366663936323064', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuEOdZsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:38 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:38 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:38 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e994bc34-2246-4260-a1d3-532e3ce0a3e2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:41:38 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3644a43a-2c97-4a9a-b889-b124cd5dc426]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80] added
Nov 14 12:41:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[820fbf7c-5152-429a-a01b-73880896dd90]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8749b3-3cc1-48d7-8f75-7a8c97ff13ec]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuEOdZsc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SuEOdZsc" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[161956ff-7700-43cd-83a2-5b6141212fe2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SuEOdZsc'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[46da27f9-c5f8-4268-ad1b-759c68895eb8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e138289-184a-4384-baa9-b04a8e3931e9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b896d48-3578-47fd-a3fb-e98cef0154d4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260]
Nov 14 12:41:38 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260] successful.
Nov 14 12:41:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17f9c56-ca21-4a61-b889-f31aab775d0f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8dc60f-8ac2-412f-bc1c-fe6df4942e8a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:38 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:41:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] HCTL ('35', '-', '-', 0) found on session 20 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cb73be-73a0-4425-94fe-ccb1f9fd2a64]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:41:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Searching for a device in session 20 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuEOdZsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23931323162303962', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23931323162303962', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfiPSukC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:41:39 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:39 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:41:39 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e35fde46-64e8-471c-bd4f-28ec133243a0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:41:39 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17585e2-8d24-4a84-9e0e-194c7f54ef20]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a] added
Nov 14 12:41:39 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[577ae8f3-40b0-424f-82a8-eb94278f66f7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ae037b3-8486-4d75-8756-4725db4c7beb]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfiPSukC {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v qfiPSukC" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fd68b75-a5ab-4d39-98e2-300feacd48b3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'qfiPSukC'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[12ad364c-c0e9-4ef8-83e3-6476e9ba9803]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7e4f33-e640-49ca-9ce8-1415a1c7ddf1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:40 user nova-compute[75258]: INFO nova.compute.manager [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Terminating instance
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45940854-e6e0-4c95-b6c2-739945c8ee67]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260]
Nov 14 12:41:40 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260] successful.
Nov 14 12:41:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c0edf5-46c9-4a6e-90f5-6bc7189222f1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[230f5b3b-ae2e-4156-b202-7e087262d4b4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:41:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:41:40 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:41:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.342s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] HCTL ('37', '-', '-', 0) found on session 21 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f35c9b9-95f6-4ca0-9b8f-75f2d7dcc131]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Searching for a device in session 21 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfiPSukC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-059e8561-c141-43f9-830e-a5791ebe763f req-a92880c2-cf84-440b-b214-6304c599125e service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-vif-unplugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-059e8561-c141-43f9-830e-a5791ebe763f req-a92880c2-cf84-440b-b214-6304c599125e service nova] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-059e8561-c141-43f9-830e-a5791ebe763f req-a92880c2-cf84-440b-b214-6304c599125e service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-059e8561-c141-43f9-830e-a5791ebe763f req-a92880c2-cf84-440b-b214-6304c599125e service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-059e8561-c141-43f9-830e-a5791ebe763f req-a92880c2-cf84-440b-b214-6304c599125e service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] No waiting events found dispatching network-vif-unplugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-059e8561-c141-43f9-830e-a5791ebe763f req-a92880c2-cf84-440b-b214-6304c599125e service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-vif-unplugged-789cac5f-ec82-4949-9568-e0064b11b92a for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:41:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Instance destroyed successfully.
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lazy-loading 'resources' on Instance uuid 4cd80282-24f6-4b44-bb13-f9586d478364 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-424583883',display_name='tempest-TestServerVolumeAttachmentScenario-server-424583883',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-424583883',id=12,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHwpspkl9wxHI0DoMJPuF/vWWO52IZep5D5MOQXZk3Mn7VJj73ltpkGbkkLc6gdDAyX3AoZFoBEHt9jVAq6Cjr2DeztCxp1N0Dn9X4/ebkX97U8CR0yx4HcG94r4LD66IA==',key_name='tempest-keypair-1051722712',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d1a340e6d62144b381c8d7b8f59641ad',ramdisk_id='',reservation_id='r-kbtjqmr0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-1340122816',owner_user_name='tempest-TestServerVolumeAttachmentScenario-1340122816-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ddb5010401df4dba8566bec73874370a',uuid=4cd80282-24f6-4b44-bb13-f9586d478364,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Converting VIF {"id": "789cac5f-ec82-4949-9568-e0064b11b92a", "address": "fa:16:3e:48:72:d4", "network": {"id": "887006f8-c372-4244-936f-8ec305c48bc5", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-901668879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.167", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d1a340e6d62144b381c8d7b8f59641ad", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap789cac5f-ec", "ovs_interfaceid": "789cac5f-ec82-4949-9568-e0064b11b92a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=789cac5f-ec82-4949-9568-e0064b11b92a,network=Network(887006f8-c372-4244-936f-8ec305c48bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789cac5f-ec') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG os_vif [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=789cac5f-ec82-4949-9568-e0064b11b92a,network=Network(887006f8-c372-4244-936f-8ec305c48bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789cac5f-ec') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap789cac5f-ec, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bd88bf7c-d8d0-4388-a1fc-75c7c1ebe992) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:40 user nova-compute[75258]: INFO os_vif [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:72:d4,bridge_name='br-int',has_traffic_filtering=True,id=789cac5f-ec82-4949-9568-e0064b11b92a,network=Network(887006f8-c372-4244-936f-8ec305c48bc5),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap789cac5f-ec')
Nov 14 12:41:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Deleting instance files /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364_del
Nov 14 12:41:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Deletion of /opt/stack/data/nova/instances/4cd80282-24f6-4b44-bb13-f9586d478364_del complete
Nov 14 12:41:40 user nova-compute[75258]: INFO nova.compute.manager [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 12:41:40 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:41:40 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== connect_volume: return (1378ms) {'type': 'block', 'scsi_wwn': '26339663636356632', 'path': '/dev/sdf'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26339663636356632', 'path': '/dev/sdf'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b4:98,bridge_name='br-int',has_traffic_filtering=True,id=7e00c907-5dd9-4bd6-b39d-301b32d2db1d,network=Network(75d9aeb4-8798-4447-8dc9-56db1cb4bcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e00c907-5d') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:76:cb,bridge_name='br-int',has_traffic_filtering=True,id=44cc718e-41e3-4891-96b9-345e3c3c9a10,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44cc718e-41') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=154ae39d-bfc2-411f-98a9-9f4f5495fc2a,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154ae39d-bf') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:96:61,bridge_name='br-int',has_traffic_filtering=True,id=2feaa2c6-358f-4218-b9e7-cd675102b831,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2feaa2c6-35') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ed:d1,bridge_name='br-int',has_traffic_filtering=True,id=e966ab8a-3429-4bc8-ac26-9e67b3ddb44b,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape966ab8a-34') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:2c:08,bridge_name='br-int',has_traffic_filtering=True,id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914c675-6b') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=a775c9a7-fe67-46da-be05-32d36f2c71f9,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa775c9a7-fe') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.objects.instance [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lazy-loading 'pci_devices' on Instance uuid 20460ef8-3184-40a3-9778-99a570da24f3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:41:41 user nova-compute[75258]:   <uuid>20460ef8-3184-40a3-9778-99a570da24f3</uuid>
Nov 14 12:41:41 user nova-compute[75258]:   <name>instance-00000014</name>
Nov 14 12:41:41 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:41:41 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:41:41 user nova-compute[75258]:   <metadata>
Nov 14 12:41:41 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:41:41 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:41:41 user nova-compute[75258]:       <nova:name>tempest-device-tagging-server-1355306843</nova:name>
Nov 14 12:41:41 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:41:37</nova:creationTime>
Nov 14 12:41:41 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:41:41 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:41:41 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:41:41 user nova-compute[75258]:       <nova:owner>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:user uuid="73d464847a1f44e38f112a5f6463abaf">tempest-TaggedBootDevicesTest-145599604-project-member</nova:user>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:project uuid="944aa8964e2d495cafdaf0eef5b61861">tempest-TaggedBootDevicesTest-145599604</nova:project>
Nov 14 12:41:41 user nova-compute[75258]:       </nova:owner>
Nov 14 12:41:41 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:41:41 user nova-compute[75258]:       <nova:ports>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:port uuid="7e00c907-5dd9-4bd6-b39d-301b32d2db1d">
Nov 14 12:41:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 12:41:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:port uuid="44cc718e-41e3-4891-96b9-345e3c3c9a10">
Nov 14 12:41:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.241" ipVersion="4"/>
Nov 14 12:41:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:port uuid="154ae39d-bfc2-411f-98a9-9f4f5495fc2a">
Nov 14 12:41:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.29" ipVersion="4"/>
Nov 14 12:41:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:port uuid="2feaa2c6-358f-4218-b9e7-cd675102b831">
Nov 14 12:41:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.41" ipVersion="4"/>
Nov 14 12:41:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:port uuid="e966ab8a-3429-4bc8-ac26-9e67b3ddb44b">
Nov 14 12:41:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.1.1.90" ipVersion="4"/>
Nov 14 12:41:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:port uuid="0914c675-6bf9-48cd-8ab0-f2426ffda9c7">
Nov 14 12:41:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Nov 14 12:41:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:41 user nova-compute[75258]:         <nova:port uuid="a775c9a7-fe67-46da-be05-32d36f2c71f9">
Nov 14 12:41:41 user nova-compute[75258]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Nov 14 12:41:41 user nova-compute[75258]:         </nova:port>
Nov 14 12:41:41 user nova-compute[75258]:       </nova:ports>
Nov 14 12:41:41 user nova-compute[75258]:     </nova:instance>
Nov 14 12:41:41 user nova-compute[75258]:   </metadata>
Nov 14 12:41:41 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:41:41 user nova-compute[75258]:     <system>
Nov 14 12:41:41 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:41:41 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:41:41 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:41:41 user nova-compute[75258]:       <entry name="serial">20460ef8-3184-40a3-9778-99a570da24f3</entry>
Nov 14 12:41:41 user nova-compute[75258]:       <entry name="uuid">20460ef8-3184-40a3-9778-99a570da24f3</entry>
Nov 14 12:41:41 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:41:41 user nova-compute[75258]:     </system>
Nov 14 12:41:41 user nova-compute[75258]:   </sysinfo>
Nov 14 12:41:41 user nova-compute[75258]:   <os>
Nov 14 12:41:41 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:41:41 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:41:41 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:41:41 user nova-compute[75258]:   </os>
Nov 14 12:41:41 user nova-compute[75258]:   <features>
Nov 14 12:41:41 user nova-compute[75258]:     <acpi/>
Nov 14 12:41:41 user nova-compute[75258]:     <apic/>
Nov 14 12:41:41 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:41:41 user nova-compute[75258]:   </features>
Nov 14 12:41:41 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:41:41 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:41:41 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:41:41 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:41:41 user nova-compute[75258]:   </clock>
Nov 14 12:41:41 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:41:41 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:41:41 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:41:41 user nova-compute[75258]:   </cpu>
Nov 14 12:41:41 user nova-compute[75258]:   <devices>
Nov 14 12:41:41 user nova-compute[75258]:     <disk type="file" device="cdrom">
Nov 14 12:41:41 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none"/>
Nov 14 12:41:41 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3/disk.config"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="hda" bus="ide"/>
Nov 14 12:41:41 user nova-compute[75258]:     </disk>
Nov 14 12:41:41 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:41:41 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:41 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <serial>cac3e17d-4dab-44a8-a88a-572c7a82544a</serial>
Nov 14 12:41:41 user nova-compute[75258]:     </disk>
Nov 14 12:41:41 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:41:41 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:41 user nova-compute[75258]:       <source dev="/dev/sdd"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <serial>2569e17f-4313-4d2f-90ff-e347f42bcc80</serial>
Nov 14 12:41:41 user nova-compute[75258]:     </disk>
Nov 14 12:41:41 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:41:41 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:41 user nova-compute[75258]:       <source dev="/dev/sdf"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="vdc" bus="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <serial>ffa8f0a2-7773-4cee-9572-9abf40acf10a</serial>
Nov 14 12:41:41 user nova-compute[75258]:     </disk>
Nov 14 12:41:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:41 user nova-compute[75258]:       <mac address="fa:16:3e:8f:b4:98"/>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="tap7e00c907-5d"/>
Nov 14 12:41:41 user nova-compute[75258]:     </interface>
Nov 14 12:41:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:41 user nova-compute[75258]:       <mac address="fa:16:3e:e2:76:cb"/>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="tap44cc718e-41"/>
Nov 14 12:41:41 user nova-compute[75258]:     </interface>
Nov 14 12:41:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:41 user nova-compute[75258]:       <mac address="fa:16:3e:5f:ac:d8"/>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="tap154ae39d-bf"/>
Nov 14 12:41:41 user nova-compute[75258]:     </interface>
Nov 14 12:41:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:41 user nova-compute[75258]:       <mac address="fa:16:3e:25:96:61"/>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="tap2feaa2c6-35"/>
Nov 14 12:41:41 user nova-compute[75258]:     </interface>
Nov 14 12:41:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:41 user nova-compute[75258]:       <mac address="fa:16:3e:0b:ed:d1"/>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="tape966ab8a-34"/>
Nov 14 12:41:41 user nova-compute[75258]:     </interface>
Nov 14 12:41:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:41 user nova-compute[75258]:       <mac address="fa:16:3e:77:2c:08"/>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="tap0914c675-6b"/>
Nov 14 12:41:41 user nova-compute[75258]:     </interface>
Nov 14 12:41:41 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:41:41 user nova-compute[75258]:       <mac address="fa:16:3e:69:81:4b"/>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:41:41 user nova-compute[75258]:       <target dev="tapa775c9a7-fe"/>
Nov 14 12:41:41 user nova-compute[75258]:     </interface>
Nov 14 12:41:41 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:41:41 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3/console.log" append="off"/>
Nov 14 12:41:41 user nova-compute[75258]:     </serial>
Nov 14 12:41:41 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:41:41 user nova-compute[75258]:     <video>
Nov 14 12:41:41 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:41:41 user nova-compute[75258]:     </video>
Nov 14 12:41:41 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:41:41 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:41:41 user nova-compute[75258]:     </rng>
Nov 14 12:41:41 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:41:41 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:41:41 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:41:41 user nova-compute[75258]:     </memballoon>
Nov 14 12:41:41 user nova-compute[75258]:   </devices>
Nov 14 12:41:41 user nova-compute[75258]: </domain>
Nov 14 12:41:41 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b4:98,bridge_name='br-int',has_traffic_filtering=True,id=7e00c907-5dd9-4bd6-b39d-301b32d2db1d,network=Network(75d9aeb4-8798-4447-8dc9-56db1cb4bcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e00c907-5d') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b4:98,bridge_name='br-int',has_traffic_filtering=True,id=7e00c907-5dd9-4bd6-b39d-301b32d2db1d,network=Network(75d9aeb4-8798-4447-8dc9-56db1cb4bcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e00c907-5d') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'ba32ed76-2ac4-5cd7-b023-f744f3c32cf2', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7e00c907-5d, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7e00c907-5d, col_values=(('qos', UUID('329de8eb-5745-41b4-aacf-c9eba21885e0')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7e00c907-5d, col_values=(('external_ids', {'iface-id': '7e00c907-5dd9-4bd6-b39d-301b32d2db1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:b4:98', 'vm-uuid': '20460ef8-3184-40a3-9778-99a570da24f3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: INFO os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:b4:98,bridge_name='br-int',has_traffic_filtering=True,id=7e00c907-5dd9-4bd6-b39d-301b32d2db1d,network=Network(75d9aeb4-8798-4447-8dc9-56db1cb4bcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e00c907-5d')
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:76:cb,bridge_name='br-int',has_traffic_filtering=True,id=44cc718e-41e3-4891-96b9-345e3c3c9a10,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44cc718e-41') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:76:cb,bridge_name='br-int',has_traffic_filtering=True,id=44cc718e-41e3-4891-96b9-345e3c3c9a10,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44cc718e-41') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '72acc8e3-1a0b-5840-a58a-2ec7486eaeef', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap44cc718e-41, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap44cc718e-41, col_values=(('qos', UUID('81f92065-2fec-4199-a353-a8f685511697')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap44cc718e-41, col_values=(('external_ids', {'iface-id': '44cc718e-41e3-4891-96b9-345e3c3c9a10', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e2:76:cb', 'vm-uuid': '20460ef8-3184-40a3-9778-99a570da24f3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: INFO os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:76:cb,bridge_name='br-int',has_traffic_filtering=True,id=44cc718e-41e3-4891-96b9-345e3c3c9a10,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44cc718e-41')
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=154ae39d-bfc2-411f-98a9-9f4f5495fc2a,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154ae39d-bf') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=154ae39d-bfc2-411f-98a9-9f4f5495fc2a,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154ae39d-bf') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8445a3c6-8a61-55c2-a044-6e0e3d7b01ce', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap154ae39d-bf, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap154ae39d-bf, col_values=(('qos', UUID('f944cc33-65e0-4500-8008-c8bbfab619d2')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap154ae39d-bf, col_values=(('external_ids', {'iface-id': '154ae39d-bfc2-411f-98a9-9f4f5495fc2a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:ac:d8', 'vm-uuid': '20460ef8-3184-40a3-9778-99a570da24f3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: INFO os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=154ae39d-bfc2-411f-98a9-9f4f5495fc2a,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154ae39d-bf')
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:96:61,bridge_name='br-int',has_traffic_filtering=True,id=2feaa2c6-358f-4218-b9e7-cd675102b831,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2feaa2c6-35') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:96:61,bridge_name='br-int',has_traffic_filtering=True,id=2feaa2c6-358f-4218-b9e7-cd675102b831,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2feaa2c6-35') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0108fcef-569f-53e7-8c0b-101ca618e093', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2feaa2c6-35, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2feaa2c6-35, col_values=(('qos', UUID('4ae1f2cc-94cb-43c5-bbfb-6fc84e4b0f06')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2feaa2c6-35, col_values=(('external_ids', {'iface-id': '2feaa2c6-358f-4218-b9e7-cd675102b831', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:96:61', 'vm-uuid': '20460ef8-3184-40a3-9778-99a570da24f3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: INFO os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:96:61,bridge_name='br-int',has_traffic_filtering=True,id=2feaa2c6-358f-4218-b9e7-cd675102b831,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2feaa2c6-35')
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ed:d1,bridge_name='br-int',has_traffic_filtering=True,id=e966ab8a-3429-4bc8-ac26-9e67b3ddb44b,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape966ab8a-34') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ed:d1,bridge_name='br-int',has_traffic_filtering=True,id=e966ab8a-3429-4bc8-ac26-9e67b3ddb44b,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape966ab8a-34') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'fb4a8e36-ef66-58cb-b682-03f72e6150d5', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape966ab8a-34, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape966ab8a-34, col_values=(('qos', UUID('37e3aaab-8c9d-48ef-b2a0-e0bf6279c5e7')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape966ab8a-34, col_values=(('external_ids', {'iface-id': 'e966ab8a-3429-4bc8-ac26-9e67b3ddb44b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0b:ed:d1', 'vm-uuid': '20460ef8-3184-40a3-9778-99a570da24f3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: INFO os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ed:d1,bridge_name='br-int',has_traffic_filtering=True,id=e966ab8a-3429-4bc8-ac26-9e67b3ddb44b,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape966ab8a-34')
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:2c:08,bridge_name='br-int',has_traffic_filtering=True,id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914c675-6b') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:2c:08,bridge_name='br-int',has_traffic_filtering=True,id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914c675-6b') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '82954af2-69e3-591d-9399-c80d75eac343', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0914c675-6b, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0914c675-6b, col_values=(('qos', UUID('225d37dc-ee76-42fd-a8ee-81660c27ca9b')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0914c675-6b, col_values=(('external_ids', {'iface-id': '0914c675-6bf9-48cd-8ab0-f2426ffda9c7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:2c:08', 'vm-uuid': '20460ef8-3184-40a3-9778-99a570da24f3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: INFO os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:2c:08,bridge_name='br-int',has_traffic_filtering=True,id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914c675-6b')
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:41:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=a775c9a7-fe67-46da-be05-32d36f2c71f9,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa775c9a7-fe') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=a775c9a7-fe67-46da-be05-32d36f2c71f9,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa775c9a7-fe') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2577820-3484-53ce-83c4-0b56bb47a014', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa775c9a7-fe, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa775c9a7-fe, col_values=(('qos', UUID('8e6f79e8-6b5b-47ed-a1b4-d4c2ccf9713b')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa775c9a7-fe, col_values=(('external_ids', {'iface-id': 'a775c9a7-fe67-46da-be05-32d36f2c71f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:69:81:4b', 'vm-uuid': '20460ef8-3184-40a3-9778-99a570da24f3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:41:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:41 user nova-compute[75258]: INFO os_vif [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=a775c9a7-fe67-46da-be05-32d36f2c71f9,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa775c9a7-fe')
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] No BDM found with device name hda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] No VIF found with MAC fa:16:3e:8f:b4:98, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] No VIF found with MAC fa:16:3e:0b:ed:d1, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:41:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Using config drive
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-932c8417-325e-4f08-8b8c-19555ad6cc9c req-ac47df0e-1524-4d9f-8ff7-0aba9d5efcce service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-vif-deleted-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:42 user nova-compute[75258]: INFO nova.compute.manager [req-932c8417-325e-4f08-8b8c-19555ad6cc9c req-ac47df0e-1524-4d9f-8ff7-0aba9d5efcce service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Neutron deleted interface 789cac5f-ec82-4949-9568-e0064b11b92a; detaching it from the instance and deleting it from the info cache
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.network.neutron [req-932c8417-325e-4f08-8b8c-19555ad6cc9c req-ac47df0e-1524-4d9f-8ff7-0aba9d5efcce service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-932c8417-325e-4f08-8b8c-19555ad6cc9c req-ac47df0e-1524-4d9f-8ff7-0aba9d5efcce service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Detach interface failed, port_id=789cac5f-ec82-4949-9568-e0064b11b92a, reason: Instance 4cd80282-24f6-4b44-bb13-f9586d478364 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:41:42 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Took 1.37 seconds to deallocate network for instance.
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-bfb32521-86b4-4879-a6d1-7113ee1e6808 req-33137798-7e2a-43ff-93ac-86214ed1f4d0 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received event network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bfb32521-86b4-4879-a6d1-7113ee1e6808 req-33137798-7e2a-43ff-93ac-86214ed1f4d0 service nova] Acquiring lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bfb32521-86b4-4879-a6d1-7113ee1e6808 req-33137798-7e2a-43ff-93ac-86214ed1f4d0 service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bfb32521-86b4-4879-a6d1-7113ee1e6808 req-33137798-7e2a-43ff-93ac-86214ed1f4d0 service nova] Lock "4cd80282-24f6-4b44-bb13-f9586d478364-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-bfb32521-86b4-4879-a6d1-7113ee1e6808 req-33137798-7e2a-43ff-93ac-86214ed1f4d0 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] No waiting events found dispatching network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:42 user nova-compute[75258]: WARNING nova.compute.manager [req-bfb32521-86b4-4879-a6d1-7113ee1e6808 req-33137798-7e2a-43ff-93ac-86214ed1f4d0 service nova] [instance: 4cd80282-24f6-4b44-bb13-f9586d478364] Received unexpected event network-vif-plugged-789cac5f-ec82-4949-9568-e0064b11b92a for instance with vm_state deleted and task_state None.
Nov 14 12:41:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Creating config drive at /opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3/disk.config
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzqgq7t8b {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpzqgq7t8b" returned: 0 in 0.068s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.393s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:42 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Deleted allocations for instance 4cd80282-24f6-4b44-bb13-f9586d478364
Nov 14 12:41:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b23f49ca-2b2f-4abf-9ff2-a93d830ec6a5 tempest-TestServerVolumeAttachmentScenario-1340122816 tempest-TestServerVolumeAttachmentScenario-1340122816-project-member] Lock "4cd80282-24f6-4b44-bb13-f9586d478364" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.808s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-a17f2490-f20b-4fcd-b09f-44fd9db16b40 req-40d164f5-eaeb-41fa-8012-3f2667e1319f service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a17f2490-f20b-4fcd-b09f-44fd9db16b40 req-40d164f5-eaeb-41fa-8012-3f2667e1319f service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a17f2490-f20b-4fcd-b09f-44fd9db16b40 req-40d164f5-eaeb-41fa-8012-3f2667e1319f service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a17f2490-f20b-4fcd-b09f-44fd9db16b40 req-40d164f5-eaeb-41fa-8012-3f2667e1319f service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-a17f2490-f20b-4fcd-b09f-44fd9db16b40 req-40d164f5-eaeb-41fa-8012-3f2667e1319f service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:44 user nova-compute[75258]: WARNING nova.compute.manager [req-a17f2490-f20b-4fcd-b09f-44fd9db16b40 req-40d164f5-eaeb-41fa-8012-3f2667e1319f service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d for instance with vm_state building and task_state spawning.
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f0eead8-47e5-4d52-9240-10226465d9f4 req-4b6ccb08-b5e2-46b4-b834-0115217b11b1 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f0eead8-47e5-4d52-9240-10226465d9f4 req-4b6ccb08-b5e2-46b4-b834-0115217b11b1 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f0eead8-47e5-4d52-9240-10226465d9f4 req-4b6ccb08-b5e2-46b4-b834-0115217b11b1 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f0eead8-47e5-4d52-9240-10226465d9f4 req-4b6ccb08-b5e2-46b4-b834-0115217b11b1 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f0eead8-47e5-4d52-9240-10226465d9f4 req-4b6ccb08-b5e2-46b4-b834-0115217b11b1 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:44 user nova-compute[75258]: WARNING nova.compute.manager [req-4f0eead8-47e5-4d52-9240-10226465d9f4 req-4b6ccb08-b5e2-46b4-b834-0115217b11b1 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a for instance with vm_state building and task_state spawning.
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-aa4de44c-9167-4029-83f0-adb2f2df1c04 req-e329d800-18d9-4574-99f6-66562502fe72 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:41:46 user nova-compute[75258]: WARNING nova.compute.manager [req-b3e64e0e-bada-4efd-a718-2917b1d95d71 req-79d24cc6-1f42-49c6-8305-cb2d0717c477 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 for instance with vm_state building and task_state spawning.
Nov 14 12:41:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:41:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance spawned successfully.
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:41:48 user nova-compute[75258]: INFO nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Took 11.20 seconds to spawn the instance on the hypervisor.
Nov 14 12:41:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:41:48 user nova-compute[75258]: INFO nova.compute.manager [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Took 33.31 seconds to build instance.
Nov 14 12:41:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-933f303d-87af-4335-8470-31ff910034cb tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "20460ef8-3184-40a3-9778-99a570da24f3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 33.409s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:41:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:41:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:41:53 user nova-compute[75258]: INFO nova.compute.manager [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Detaching volume 379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:41:53 user nova-compute[75258]: INFO nova.virt.block_device [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Attempting to driver detach volume 379c71d5-e136-4ba2-b189-a24752992f77 from mountpoint /dev/vdb
Nov 14 12:41:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Attempting to detach device vdb from instance ac186509-f835-453a-b683-c6d3901babba from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:41:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:41:53 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:53 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:41:53 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:41:53 user nova-compute[75258]:   <serial>379c71d5-e136-4ba2-b189-a24752992f77</serial>
Nov 14 12:41:53 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 12:41:53 user nova-compute[75258]: </disk>
Nov 14 12:41:53 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:41:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully detached device vdb from instance ac186509-f835-453a-b683-c6d3901babba from the persistent domain config.
Nov 14 12:41:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ac186509-f835-453a-b683-c6d3901babba from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:41:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:41:53 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:41:53 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:41:53 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:41:53 user nova-compute[75258]:   <serial>379c71d5-e136-4ba2-b189-a24752992f77</serial>
Nov 14 12:41:53 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 12:41:53 user nova-compute[75258]: </disk>
Nov 14 12:41:53 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:41:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:41:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:41:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:42:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:42:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:42:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:42:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:42:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 12:42:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:06 user nova-compute[75258]: INFO nova.compute.manager [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Terminating instance
Nov 14 12:42:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-579340e6-679c-4461-a612-25687432a797 req-4e6731f6-07d3-48a5-9b4b-e139747ef9a1 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-vif-unplugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-579340e6-679c-4461-a612-25687432a797 req-4e6731f6-07d3-48a5-9b4b-e139747ef9a1 service nova] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-579340e6-679c-4461-a612-25687432a797 req-4e6731f6-07d3-48a5-9b4b-e139747ef9a1 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-579340e6-679c-4461-a612-25687432a797 req-4e6731f6-07d3-48a5-9b4b-e139747ef9a1 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-579340e6-679c-4461-a612-25687432a797 req-4e6731f6-07d3-48a5-9b4b-e139747ef9a1 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] No waiting events found dispatching network-vif-unplugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-579340e6-679c-4461-a612-25687432a797 req-4e6731f6-07d3-48a5-9b4b-e139747ef9a1 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-vif-unplugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Instance destroyed successfully.
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lazy-loading 'resources' on Instance uuid 3121053b-59aa-4412-aee7-a4b54d99d50d {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1251237813',display_name='tempest-VolumesAdminNegativeTest-server-1251237813',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-1251237813',id=4,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPjLql/Jur4U4HM4M1dV5bSNOrNBSrpvTLVqIrl+amHw+xzMG+8humw/3fqlNkFH2DIBmXytL0keCgNvjhpbiZph+zJnj0J61q7p+YBgFrmgQ/VyXMXhIUJbxxEdBuDRFg==',key_name='tempest-keypair-353647684',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a5b09a067539485181c0bd2f6edb4651',ramdisk_id='',reservation_id='r-0f7yln35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-746118338',owner_user_name='tempest-VolumesAdminNegativeTest-746118338-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:36:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='61b84b06ec4247bca42431850be2d0c7',uuid=3121053b-59aa-4412-aee7-a4b54d99d50d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converting VIF {"id": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "address": "fa:16:3e:f3:7a:fb", "network": {"id": "127ac5d7-9c5a-4118-88b9-4f10fded23e6", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-726705168-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a5b09a067539485181c0bd2f6edb4651", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf2a19abe-f2", "ovs_interfaceid": "f2a19abe-f21b-4f2e-9f66-ecaa8194805f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:7a:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a19abe-f2') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG os_vif [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:7a:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a19abe-f2') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf2a19abe-f2, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=39684c13-184d-416a-a292-51733515fac5) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:42:07 user nova-compute[75258]: INFO os_vif [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:7a:fb,bridge_name='br-int',has_traffic_filtering=True,id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f,network=Network(127ac5d7-9c5a-4118-88b9-4f10fded23e6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf2a19abe-f2')
Nov 14 12:42:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Deleting instance files /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d_del
Nov 14 12:42:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Deletion of /opt/stack/data/nova/instances/3121053b-59aa-4412-aee7-a4b54d99d50d_del complete
Nov 14 12:42:07 user nova-compute[75258]: INFO nova.compute.manager [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 12:42:07 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:42:08 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Took 0.88 seconds to deallocate network for instance.
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-d6ad2b09-5d89-44ee-a490-4d2d85055458 req-63ebc00f-f4a0-44a4-a7e8-3bd7f999c378 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-vif-deleted-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:08 user nova-compute[75258]: INFO nova.compute.manager [req-d6ad2b09-5d89-44ee-a490-4d2d85055458 req-63ebc00f-f4a0-44a4-a7e8-3bd7f999c378 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Neutron deleted interface f2a19abe-f21b-4f2e-9f66-ecaa8194805f; detaching it from the instance and deleting it from the info cache
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.network.neutron [req-d6ad2b09-5d89-44ee-a490-4d2d85055458 req-63ebc00f-f4a0-44a4-a7e8-3bd7f999c378 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-d6ad2b09-5d89-44ee-a490-4d2d85055458 req-63ebc00f-f4a0-44a4-a7e8-3bd7f999c378 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Detach interface failed, port_id=f2a19abe-f21b-4f2e-9f66-ecaa8194805f, reason: Instance 3121053b-59aa-4412-aee7-a4b54d99d50d could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:08 user nova-compute[75258]: INFO nova.compute.manager [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attaching volume ccba0f78-3688-49b2-87d6-506ad563b7da to /dev/vdb
Nov 14 12:42:08 user nova-compute[75258]: DEBUG os_brick.utils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63ff8c7-0286-4e39-a3ea-9dac062715fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa6b0027-ba7e-4359-815f-a4e6203b2f45]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[14b02537-7535-4182-88a2-3dad7968921e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a01335b-25c9-42ea-a2c9-058a9569af22]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:08 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e62bec6-8bb1-43a5-b5e8-492730390722]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG os_brick.utils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating existing volume attachment record: ef94686b-7ac9-4d4c-bb57-41ff3d918c43 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.521s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-03fb819f-5570-4721-95d4-a824ca39d147 req-7073bbf3-7e02-4af3-b102-3aaf91e05a31 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received event network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-03fb819f-5570-4721-95d4-a824ca39d147 req-7073bbf3-7e02-4af3-b102-3aaf91e05a31 service nova] Acquiring lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-03fb819f-5570-4721-95d4-a824ca39d147 req-7073bbf3-7e02-4af3-b102-3aaf91e05a31 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-03fb819f-5570-4721-95d4-a824ca39d147 req-7073bbf3-7e02-4af3-b102-3aaf91e05a31 service nova] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-03fb819f-5570-4721-95d4-a824ca39d147 req-7073bbf3-7e02-4af3-b102-3aaf91e05a31 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] No waiting events found dispatching network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:08 user nova-compute[75258]: WARNING nova.compute.manager [req-03fb819f-5570-4721-95d4-a824ca39d147 req-7073bbf3-7e02-4af3-b102-3aaf91e05a31 service nova] [instance: 3121053b-59aa-4412-aee7-a4b54d99d50d] Received unexpected event network-vif-plugged-f2a19abe-f21b-4f2e-9f66-ecaa8194805f for instance with vm_state deleted and task_state None.
Nov 14 12:42:08 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Deleted allocations for instance 3121053b-59aa-4412-aee7-a4b54d99d50d
Nov 14 12:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-398a30b1-9cb6-48db-aa5d-8eebcaa0131c tempest-VolumesAdminNegativeTest-746118338 tempest-VolumesAdminNegativeTest-746118338-project-member] Lock "3121053b-59aa-4412-aee7-a4b54d99d50d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.586s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vdc) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e/disk.rescue --force-share --output=json" returned: 0 in 0.227s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.230s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.203s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ac186509-f835-453a-b683-c6d3901babba is timed out.
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-changed-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Refreshing instance network info cache due to event network-changed-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] Acquiring lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] Acquired lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.network.neutron [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Refreshing network info cache for port 48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:42:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully detached device vdb from instance ac186509-f835-453a-b683-c6d3901babba from the live domain config.
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'EonGjVlQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:14 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:42:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7550MB free_disk=24.583332061767578GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.060s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c396d4d2-3afc-4136-8a3c-5764a2f85610]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:42:14 user nova-compute[75258]: No targets found.
Nov 14 12:42:14 user nova-compute[75258]: iSNS:
Nov 14 12:42:14 user nova-compute[75258]: No targets found.
Nov 14 12:42:14 user nova-compute[75258]: STATIC:
Nov 14 12:42:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:42:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:42:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77
Nov 14 12:42:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37
Nov 14 12:42:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:42:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:42:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:14 user nova-compute[75258]: FIRMWARE:
Nov 14 12:42:14 user nova-compute[75258]: No targets found.
Nov 14 12:42:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:42:14 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:42:14 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lazy-loading 'flavor' on Instance uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f7ad47-f195-47bf-8ee2-4dd4861c3304]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.072s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[97550b9b-df01-4620-a0db-81163df7edbb]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7d7490>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 10574d06-4168-43c2-bf6b-22a1a55febab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 20460ef8-3184-40a3-9778-99a570da24f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0638bdea-186e-4258-b4da-f78f59477e91]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d21917c-592f-42e0-96e2-76698232ff0c]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFulZExO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:14 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63875297-6ae8-4640-b8c5-33082961ce81]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.050s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba1eeb8b-5628-4710-a104-669817925712]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[247e1ec7-a2b7-4894-97a8-f5139aa2bd2e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:14 user nova-compute[75258]: INFO nova.compute.manager [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Attaching volume da5e7100-0506-471f-9928-c95791152cfe to /dev/vdb
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e8088b-8902-4bce-a39f-c9ee9f707964]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260]
Nov 14 12:42:14 user nova-compute[75258]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.utils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:379c71d5-e136-4ba2-b189-a24752992f77 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8720bcd9-ebc4-4f93-9e40-b22ba4248328]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.456s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== disconnect_volume: return (458ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cc952e-6f9f-4a04-b836-416c86779de6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.243s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:14 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:14 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d125504-ef71-4ea0-9fdc-684ca4fbf722]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:42:14 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a5834a6-af5d-447f-b851-f4ca4afe6a37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.499s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c853e13b-b06d-4add-8c5b-bb010958f07b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da] added
Nov 14 12:42:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d02d9a8-5e5f-4909-b5cc-ba83b1645aab]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5fe195c-7752-4c13-9f5d-bfff58a6272d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.network.neutron [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Updated VIF entry in instance network info cache for port 48dbd1aa-4424-4a29-8054-5a5d8d53bf8a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.network.neutron [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Updating instance_info_cache with network_info: [{"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbc902cd-e9d1-4c65-9d1c-66af10141d5c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b83c7712-a7a7-4c92-b171-15e2c5122bd4 req-5f0e1209-d8e3-4d7d-acd0-1fea97c1a437 service nova] Releasing lock "refresh_cache-10574d06-4168-43c2-bf6b-22a1a55febab" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:14 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdcb9563-e55d-48b4-9219-3b8f02c2a70f]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.utils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] <== get_connector_properties: return (189ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Updating existing volume attachment record: 9dcf9534-e8ee-4e7e-8620-a9d744390767 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5000cbfa-172d-486d-8c4e-6895a86b0ca4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFulZExO {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.auth.username -v gFulZExO" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a196bf-a6e7-4049-b24a-2714cdc7f4af]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'gFulZExO'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e842e99a-4aa7-4409-b75c-d983b5443c97]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b42cd53-0ab6-45dc-9cde-7e63f61e991a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:14 user nova-compute[75258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)
Nov 14 12:42:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --login" returned: 0 in 0.085s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8f329a-0162-42e4-8805-86a19b180534]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260]
Nov 14 12:42:15 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a50ca611-1b59-4fa7-bd2d-67ccbf9cdd32]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eb1230e-909d-45fe-9c53-106e499a8616]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3f71ae8d-e0ea-4a39-8e6f-21f31f3bff37 (non-flash)
Nov 14 12:42:15 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.399s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] HCTL ('36', '-', '-', 0) found on session 23 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4925981a-24a1-418b-b2e5-d717de784759]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Searching for a device in session 23 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFulZExO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.objects.instance [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2d2fba4d-20f9-4050-9852-03aba39ec855 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.057s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.436s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== connect_volume: return (1678ms) {'type': 'block', 'scsi_wwn': '23633383534643939', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23633383534643939', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:42:16 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:16 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:42:16 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:16 user nova-compute[75258]:   <serial>ccba0f78-3688-49b2-87d6-506ad563b7da</serial>
Nov 14 12:42:16 user nova-compute[75258]: </disk>
Nov 14 12:42:16 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d16d5d1f-d8a5-446f-8416-6f93488ee48a tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d16d5d1f-d8a5-446f-8416-6f93488ee48a tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d16d5d1f-d8a5-446f-8416-6f93488ee48a tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d16d5d1f-d8a5-446f-8416-6f93488ee48a tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=75258) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3358}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.objects.instance [None req-d16d5d1f-d8a5-446f-8416-6f93488ee48a tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] No VIF found with MAC fa:16:3e:e8:ff:7e, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a34b1aac-fdb7-470f-ac5d-29fc2cdfd3f2 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 8.635s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-4134f65b-0176-4d18-9149-db6d9013548e req-7268566a-0661-4789-98d4-350455c5c474 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4134f65b-0176-4d18-9149-db6d9013548e req-7268566a-0661-4789-98d4-350455c5c474 service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4134f65b-0176-4d18-9149-db6d9013548e req-7268566a-0661-4789-98d4-350455c5c474 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4134f65b-0176-4d18-9149-db6d9013548e req-7268566a-0661-4789-98d4-350455c5c474 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-4134f65b-0176-4d18-9149-db6d9013548e req-7268566a-0661-4789-98d4-350455c5c474 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:16 user nova-compute[75258]: WARNING nova.compute.manager [req-4134f65b-0176-4d18-9149-db6d9013548e req-7268566a-0661-4789-98d4-350455c5c474 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state active and task_state powering-off.
Nov 14 12:42:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:17 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance destroyed successfully.
Nov 14 12:42:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d16d5d1f-d8a5-446f-8416-6f93488ee48a tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:42:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d16d5d1f-d8a5-446f-8416-6f93488ee48a tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.899s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-a021bfda-b124-4404-a042-44c858423537 req-982aa788-35cc-465b-a910-4dc070c66700 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a021bfda-b124-4404-a042-44c858423537 req-982aa788-35cc-465b-a910-4dc070c66700 service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a021bfda-b124-4404-a042-44c858423537 req-982aa788-35cc-465b-a910-4dc070c66700 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a021bfda-b124-4404-a042-44c858423537 req-982aa788-35cc-465b-a910-4dc070c66700 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-a021bfda-b124-4404-a042-44c858423537 req-982aa788-35cc-465b-a910-4dc070c66700 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:18 user nova-compute[75258]: WARNING nova.compute.manager [req-a021bfda-b124-4404-a042-44c858423537 req-982aa788-35cc-465b-a910-4dc070c66700 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state stopped and task_state None.
Nov 14 12:42:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:19 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:19 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:19 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f295ff1-2700-47ec-b343-57b5cf2abaae]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:42:19 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5941eec-a36f-4d0d-ad46-c0bb55b7d1f7]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe] added
Nov 14 12:42:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e85ddc03-89c5-4a29-8e6a-332993493cb2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[49a065df-4e9b-4e76-8bab-4849309d1dea]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnZXGyru {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnZXGyru" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a498d92-0544-4840-9df9-80709ebb7726]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HnZXGyru'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[10923bdc-5611-425a-83b9-60fab433db1c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:19 user nova-compute[75258]: INFO nova.compute.manager [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Detaching volume ccba0f78-3688-49b2-87d6-506ad563b7da
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fa3abe-8fdb-4ffe-a30c-c2a68c435bc0]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: INFO nova.virt.block_device [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Attempting to driver detach volume ccba0f78-3688-49b2-87d6-506ad563b7da from mountpoint /dev/vdb
Nov 14 12:42:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Attempting to detach device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:42:19 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:19 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:42:19 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:19 user nova-compute[75258]:   <serial>ccba0f78-3688-49b2-87d6-506ad563b7da</serial>
Nov 14 12:42:19 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:42:19 user nova-compute[75258]: </disk>
Nov 14 12:42:19 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:42:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the persistent domain config.
Nov 14 12:42:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:42:19 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:19 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:42:19 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:19 user nova-compute[75258]:   <serial>ccba0f78-3688-49b2-87d6-506ad563b7da</serial>
Nov 14 12:42:19 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:42:19 user nova-compute[75258]: </disk>
Nov 14 12:42:19 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[12757d7c-1e33-4544-bc2e-41fc4c7d3cbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]
Nov 14 12:42:19 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[104a70a0-b82e-4280-b541-92bce35e3394]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f67c05-0be0-4d6a-8c22-020c38b43896]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:19 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] HCTL ('38', '-', '-', 0) found on session 24 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d007f309-c75b-4c3d-9244-b3a6ea74f568]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Searching for a device in session 24 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:42:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:42:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:42:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.356s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] <== connect_volume: return (1357ms) {'type': 'block', 'scsi_wwn': '26265353165363434', 'path': '/dev/sdg'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265353165363434', 'path': '/dev/sdg'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:42:20 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lazy-loading 'flavor' on Instance uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:42:20 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:20 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:42:20 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:20 user nova-compute[75258]:   <serial>da5e7100-0506-471f-9928-c95791152cfe</serial>
Nov 14 12:42:20 user nova-compute[75258]: </disk>
Nov 14 12:42:20 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:42:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:42:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:42:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] No VIF found with MAC fa:16:3e:78:d2:8b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:42:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5cd6b574-ce54-43e7-9388-7fd11c608c84 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.879s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG os_brick.utils [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[af4f810b-b74a-4c0e-bf7a-bcdd165cd731]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3dba7df-2e9f-43d4-af8a-742f36cca502]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e76e0cec-7423-476b-9679-d2f4cc557122]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[75cdd144-a8f4-43b9-8038-d3a91dea9fcf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:22 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:42:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a65b81a-bf7e-4dc4-bc3c-16072db9ea16]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:42:22 user nova-compute[75258]: DEBUG os_brick.utils [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] <== get_connector_properties: return (135ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:23 user nova-compute[75258]: INFO nova.compute.manager [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Swapping volume da5e7100-0506-471f-9928-c95791152cfe for bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8
Nov 14 12:42:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-changed-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Refreshing instance network info cache due to event network-changed-af2f80aa-4b8b-4ba8-9b35-6ac29459178b. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] Acquiring lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] Acquired lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Refreshing network info cache for port af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'flavor' on Instance uuid e4f541b4-6f64-4e49-9d46-5806aeba8ad8 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:25 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Ignoring supplied device name: /dev/vdb
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:25 user nova-compute[75258]: INFO nova.compute.manager [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Attaching volume 4b229cda-d802-47a3-b855-d97521ece1d3 to /dev/vdb
Nov 14 12:42:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Updated VIF entry in instance network info cache for port af2f80aa-4b8b-4ba8-9b35-6ac29459178b. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Updating instance_info_cache with network_info: [{"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c2e0c0ea-932f-4cee-a9aa-8e7d33e298d5 req-15f24f97-f566-45de-ba6b-600eddd56d8c service nova] Releasing lock "refresh_cache-e4f541b4-6f64-4e49-9d46-5806aeba8ad8" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG os_brick.utils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f92c574-d3bb-4d35-977d-96080269f9ed]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[39a952a4-62c5-4824-a1b6-d341913cccb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[97fb283e-af6a-4c2a-8335-a92ffd9b9ed6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e91a07-41cc-457a-8d94-8d4d5785114d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:25 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:42:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c383563d-b5e0-4c8d-ac6d-156d3e9483fd]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG os_brick.utils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:25 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Updating existing volume attachment record: f397eeed-0262-428a-908a-a37b2c057c1e {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:42:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weDUpYqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10574d06-4168-43c2-bf6b-22a1a55febab', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'serial': 'bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '10574d06-4168-43c2-bf6b-22a1a55febab', 'attached_at': '', 'detached_at': '', 'volume_id': 'da5e7100-0506-471f-9928-c95791152cfe', 'serial'} {{(pid=75258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weDUpYqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:28 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:28 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:28 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[552a9041-6824-4e1d-b087-2bd925a2687e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:42:28 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80fdd4a3-6ffc-4168-9011-1c0a110fc59e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8] added
Nov 14 12:42:28 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[44b23d46-e479-471b-9f7a-2e1757287b3e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b52e479c-be03-4ff9-8b00-2c915e5ea533]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weDUpYqQ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v weDUpYqQ" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8302b9f1-28cb-4f56-9f2c-2105db8ad93d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'weDUpYqQ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eecd5b91-aa7e-4533-affc-e433dbfe3786]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[33bf3e76-4dfa-48a9-aa39-e8953cf35324]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:28 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:28 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f111cab-4dfc-4e94-a903-fd8fa509d040]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260]
Nov 14 12:42:28 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:28 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[270c6773-ab99-4bab-8f16-3c7555da2811]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e77285fa-1fcf-487b-911c-1ee0239fc27a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:28 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:28 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] HCTL ('39', '-', '-', 0) found on session 25 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Scanning host 39 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[898a23d3-2fb2-4383-8891-56d6602db3aa]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Searching for a device in session 25 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weDUpYqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:42:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.353s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23232656366656532', 'path': '/dev/sdh'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23232656366656532', 'path': '/dev/sdh'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:42:29 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lazy-loading 'flavor' on Instance uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 9437184 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 183500800 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFJDzNYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:30 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:30 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:30 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260" returned: 21 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec996828-2257-4dbd-a567-13fc20d13360]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:42:30 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc29061-9d10-43cc-be8a-8f50e88f78bf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3] added
Nov 14 12:42:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d42fc29-2680-4aad-94b7-d02fa01de136]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c02292-7579-4160-9984-c95a82c519f1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFJDzNYf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pFJDzNYf" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed2ba7aa-1e5d-4fe6-9578-de023538f23a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pFJDzNYf'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe6be09d-b275-4d28-8a5b-2587c53fb219]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.037s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a4be1c-0655-4789-ae9f-6c4fae9307b3]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:30 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 358612992 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --login" returned: 0 in 0.110s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e269fcae-eddb-4775-98e9-ce874550511b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260]
Nov 14 12:42:30 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b226217-c4d2-4043-b3ff-abbd493e5e66]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.044s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2010a53-647a-4fd9-8e77-6e0b3d24fb21]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] HCTL ('40', '-', '-', 0) found on session 26 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Scanning host 40 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host40/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host40/scan" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[96f81ec3-3376-4919-957d-18588203c6fa]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Searching for a device in session 26 and hctl ['40', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:42:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 501219328 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 645922816 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Searching for a device in session 26 and hctl ['40', '*', '*', 0] yield: sdi {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Connected to sdi using {'target_iqn': 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFJDzNYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.475s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== connect_volume: return (1477ms) {'type': 'block', 'scsi_wwn': '23363373438313638', 'path': '/dev/sdi'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23363373438313638', 'path': '/dev/sdi'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'flavor' on Instance uuid e4f541b4-6f64-4e49-9d46-5806aeba8ad8 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:42:32 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:32 user nova-compute[75258]:   <source dev="/dev/sdi"/>
Nov 14 12:42:32 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:32 user nova-compute[75258]:   <serial>4b229cda-d802-47a3-b855-d97521ece1d3</serial>
Nov 14 12:42:32 user nova-compute[75258]: </disk>
Nov 14 12:42:32 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 800063488 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] No VIF found with MAC fa:16:3e:4a:ce:a7, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:42:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e45c519-4e5d-433c-be0d-8b11c831ac96 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 7.632s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 937426944 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:33 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[405320ea-adfa-466c-bc5e-5a0a65a2f4db]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:42:33 user nova-compute[75258]: No targets found.
Nov 14 12:42:33 user nova-compute[75258]: iSNS:
Nov 14 12:42:33 user nova-compute[75258]: No targets found.
Nov 14 12:42:33 user nova-compute[75258]: STATIC:
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:42:33 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:33 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:33 user nova-compute[75258]: FIRMWARE:
Nov 14 12:42:33 user nova-compute[75258]: No targets found.
Nov 14 12:42:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:42:33 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:42:33 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce1e3e2c-3ab4-47ca-ac2a-c4973a703649]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd18125-8662-4b54-84b3-6277ca199494]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7981f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe'): ({'sdg'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Removing single pathed devices sdg {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f1df26-690e-4f5c-be33-4571e2323f46]: (4, ('path checker states:\nup                  8\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51195dba-7676-49fc-b978-4b40294deeb6]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Flushing IO for device /dev/sdg {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2afa988-9184-4ece-ad7b-a52bc5b2dfd3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.044s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[141d20d8-c7d7-41fe-8e7f-227693593c48]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Checking to see if SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e14fdb-909f-478f-8b05-4dbc2153e98a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c94347df-68e6-431a-8151-306dc1d5de7f]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]
Nov 14 12:42:34 user nova-compute[75258]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:34 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.038s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[08836ef0-80e9-46ad-b50f-c815cfa6828d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] <== disconnect_volume: return (435ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weDUpYqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, 'status': 'reserved', 'instance': '10574d06-4168-43c2-bf6b-22a1a55febab', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'serial'} {{(pid=75258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 12:42:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] swap_volume: removing Cinder connection for volume da5e7100-0506-471f-9928-c95791152cfe {{(pid=75258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 12:42:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] swap_volume: Updating volume da5e7100-0506-471f-9928-c95791152cfe BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "weDUpYqQ", "auth_password": "ZDVfr6nGYSqA2T", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdh", "volume_id": "bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8"}, "status": "reserved", "instance": "10574d06-4168-43c2-bf6b-22a1a55febab", "attached_at": "", "detached_at": "", "volume_id": "bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8", "serial": "bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'no_device': None, 'attachment_id': '292b1563-8d61-4d76-a882-75f55942b351'} {{(pid=75258) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 12:42:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e3cfa066-bd07-4582-a674-7e14a1eba75a tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 12.556s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG os_brick.utils [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[144f945e-985b-4e35-b68f-09b7c410f886]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e775620d-506f-4342-b44a-12681ff9c92e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a15636f-3af5-4688-9479-ad81fa402588]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e576f95f-a0ad-42a1-85d8-467dc2d232ff]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:42:36 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:42:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4e9f19b-bbb3-4f0a-9eee-21d1c4d45938]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:42:36 user nova-compute[75258]: DEBUG os_brick.utils [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] <== get_connector_properties: return (123ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:36 user nova-compute[75258]: INFO nova.compute.manager [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Swapping volume bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 for da5e7100-0506-471f-9928-c95791152cfe
Nov 14 12:42:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:40 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 is timed out.
Nov 14 12:42:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully detached device vdb from instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 from the live domain config.
Nov 14 12:42:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'gFulZExO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:40 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40f646b-16c6-4876-ad24-8e27e8e326ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:42:40 user nova-compute[75258]: No targets found.
Nov 14 12:42:40 user nova-compute[75258]: iSNS:
Nov 14 12:42:40 user nova-compute[75258]: No targets found.
Nov 14 12:42:40 user nova-compute[75258]: STATIC:
Nov 14 12:42:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:42:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8
Nov 14 12:42:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3
Nov 14 12:42:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:42:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da
Nov 14 12:42:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:42:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:42:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:40 user nova-compute[75258]: FIRMWARE:
Nov 14 12:42:40 user nova-compute[75258]: No targets found.
Nov 14 12:42:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:42:40 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:42:40 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0f7c07-3c03-4cc3-b8cb-3504324b85a6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df33a170-b2aa-4158-8bb4-459933c4a780]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7e7eb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd93215-ba45-456e-9c19-736cfedb30f4]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[50dbc3ae-f363-4714-abd9-56bdf514b47f]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[54249811-2eb4-4244-aa15-85b516382c06]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86b4ffd-97d1-4a4c-89d1-2f1f9dc38d96]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6327340f-d7fd-454b-9d5c-38d8ec277c4f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[364ecc9e-ae17-43f1-9d2b-5cff0501e1b7]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260]
Nov 14 12:42:40 user nova-compute[75258]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ccba0f78-3688-49b2-87d6-506ad563b7da -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cda9281-954f-4d97-b825-33f19f9366d6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.447s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] <== disconnect_volume: return (448ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:40 user nova-compute[75258]: INFO nova.compute.manager [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Detaching volume 4b229cda-d802-47a3-b855-d97521ece1d3
Nov 14 12:42:41 user nova-compute[75258]: INFO nova.virt.block_device [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Attempting to driver detach volume 4b229cda-d802-47a3-b855-d97521ece1d3 from mountpoint /dev/vdb
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Attempting to detach device vdb from instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:42:41 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:41 user nova-compute[75258]:   <source dev="/dev/sdi"/>
Nov 14 12:42:41 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:41 user nova-compute[75258]:   <serial>4b229cda-d802-47a3-b855-d97521ece1d3</serial>
Nov 14 12:42:41 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:42:41 user nova-compute[75258]: </disk>
Nov 14 12:42:41 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:42:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully detached device vdb from instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 from the persistent domain config.
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:42:41 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:41 user nova-compute[75258]:   <source dev="/dev/sdi"/>
Nov 14 12:42:41 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:41 user nova-compute[75258]:   <serial>4b229cda-d802-47a3-b855-d97521ece1d3</serial>
Nov 14 12:42:41 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:42:41 user nova-compute[75258]: </disk>
Nov 14 12:42:41 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.objects.instance [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'flavor' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '10574d06-4168-43c2-bf6b-22a1a55febab', 'attached_at': '', 'detached_at': '', 'volume_id': 'da5e7100-0506-471f-9928-c95791152cfe', 'serial': 'da5e7100-0506-471f-9928-c95791152cfe'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weDUpYqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8'}, 'status': 'reserved', 'instance': '10574d06-4168-43c2-bf6b-22a1a55febab', 'attached_at': '', 'detached_at': '', 'volume_id': 'bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'serial'} {{(pid=75258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7782}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:41 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3133967a-5ef7-4d59-91d4-9c3fc4825c84]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:42:41 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bb1ae259-2cef-41e2-a649-92ad3d616510 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.835s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e22a2460-69ff-4ef5-9c84-6e1952535b58]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe] added
Nov 14 12:42:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3563cd01-f43c-4873-a569-f3ba262f946f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb0654-cd89-4c0b-a13f-cb1d7f4d7c70]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnZXGyru {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HnZXGyru" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[86a78078-7fa1-4caf-82ec-c5946fa40d38]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HnZXGyru'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de4dcb9-e3f9-494c-8a8c-ad169e912ed9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13912935-1fb8-4e51-8d05-3ec20bf8cf33]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --login" returned: 0 in 0.076s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3547c0ff-383a-44fd-b778-94568872f359]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]
Nov 14 12:42:41 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0389a23-3b16-499b-b1f9-f334fcc55a69]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89c3c662-5bee-447b-9844-1fcfd3e23d6b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:41 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.302s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] HCTL ('36', '-', '-', 0) found on session 27 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[be76c605-7670-4779-8042-dec3405b1ee8]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Searching for a device in session 27 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:42:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '26265353165363434', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26265353165363434', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:42:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lazy-loading 'flavor' on Instance uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 122683392 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 308281344 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 484442112 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 665845760 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 843055104 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 1030750208 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'weDUpYqQ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh', 'volume_id': 'bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:42:46 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c23c5b40-77ca-4ed9-b879-727615a7c315]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:42:46 user nova-compute[75258]: No targets found.
Nov 14 12:42:46 user nova-compute[75258]: iSNS:
Nov 14 12:42:46 user nova-compute[75258]: No targets found.
Nov 14 12:42:46 user nova-compute[75258]: STATIC:
Nov 14 12:42:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:42:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8
Nov 14 12:42:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3
Nov 14 12:42:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:42:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe
Nov 14 12:42:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:42:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:46 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:42:46 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:42:46 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:42:46 user nova-compute[75258]: FIRMWARE:
Nov 14 12:42:46 user nova-compute[75258]: No targets found.
Nov 14 12:42:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:42:46 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:42:46 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[153927a2-9613-48c6-8798-9bbeb586951e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[474daf21-bec9-4cb1-ada4-e8166c3b4744]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:42:46 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:42:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c798700>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8'): ({'sdh'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Removing single pathed devices sdh {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d72c7f5-665a-4393-af93-a4c5085e19f7]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a44314d-11c4-4cdd-b3bb-e1f4eb019f24]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Flushing IO for device /dev/sdh {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9811f44d-8322-4ebc-822c-6fe0d401d096]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:42:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ed6f46-9a1a-421e-950c-0d3f14cf9b56]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Checking to see if SCSI volumes sdh have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] SCSI volumes sdh have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[29bb3d62-9c32-4c23-9183-6e78fe65dc16]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a52267-57fe-4c47-8309-77a0a4b95ef8]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260]
Nov 14 12:42:47 user nova-compute[75258]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8, portal: 172.16.0.220,3260] successful.
Nov 14 12:42:47 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0966f4-71d8-4690-b644-e9e6e05296c1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.340s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] <== disconnect_volume: return (341ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '10574d06-4168-43c2-bf6b-22a1a55febab', 'attached_at': '', 'detached_at': '', 'volume_id': 'da5e7100-0506-471f-9928-c95791152cfe', 'serial'} {{(pid=75258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7791}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] swap_volume: removing Cinder connection for volume bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 {{(pid=75258) _swap_volume /opt/stack/nova/nova/compute/manager.py:7836}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid e4f541b4-6f64-4e49-9d46-5806aeba8ad8 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 20460ef8-3184-40a3-9778-99a570da24f3 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "675b780c-92f9-41de-9457-ae035af15eeb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "20460ef8-3184-40a3-9778-99a570da24f3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.063s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.068s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "675b780c-92f9-41de-9457-ae035af15eeb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.069s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.072s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.082s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "20460ef8-3184-40a3-9778-99a570da24f3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] swap_volume: Updating volume bcbeda7b-d3e9-4331-95aa-d5e58a5c6de8 BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "HnZXGyru", "auth_password": "pXgfiJo6UHhakL", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "da5e7100-0506-471f-9928-c95791152cfe"}, "status": "reserved", "instance": "10574d06-4168-43c2-bf6b-22a1a55febab", "attached_at": "", "detached_at": "", "volume_id": "da5e7100-0506-471f-9928-c95791152cfe", "serial": "da5e7100-0506-471f-9928-c95791152cfe"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'da5e7100-0506-471f-9928-c95791152cfe', 'no_device': None, 'attachment_id': '29630403-8241-4d63-bf97-ba207d6e4f69'} {{(pid=75258) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7984}}
Nov 14 12:42:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6400e3d3-8989-4609-928b-c71c1119759f tempest-TestVolumeSwap-692580465 tempest-TestVolumeSwap-692580465-project-admin] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 11.853s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.556s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.028s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:49 user nova-compute[75258]: INFO nova.compute.manager [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Detaching volume da5e7100-0506-471f-9928-c95791152cfe
Nov 14 12:42:49 user nova-compute[75258]: INFO nova.virt.block_device [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Attempting to driver detach volume da5e7100-0506-471f-9928-c95791152cfe from mountpoint /dev/vdb
Nov 14 12:42:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Attempting to detach device vdb from instance 10574d06-4168-43c2-bf6b-22a1a55febab from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:42:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:42:49 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:49 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:42:49 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:49 user nova-compute[75258]:   <serial>da5e7100-0506-471f-9928-c95791152cfe</serial>
Nov 14 12:42:49 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:42:49 user nova-compute[75258]: </disk>
Nov 14 12:42:49 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:42:49 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Successfully detached device vdb from instance 10574d06-4168-43c2-bf6b-22a1a55febab from the persistent domain config.
Nov 14 12:42:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 10574d06-4168-43c2-bf6b-22a1a55febab from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:42:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:42:49 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:42:49 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:42:49 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:42:49 user nova-compute[75258]:   <serial>da5e7100-0506-471f-9928-c95791152cfe</serial>
Nov 14 12:42:49 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:42:49 user nova-compute[75258]: </disk>
Nov 14 12:42:49 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:42:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:42:50 user nova-compute[75258]: INFO nova.compute.manager [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Unrescuing
Nov 14 12:42:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:42:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:42:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'flavor' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-c63a7b60-ea48-4458-b94f-2fe286c1ae53 req-7e62d814-cdce-4293-a76e-1fa9ab00dbbd service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c63a7b60-ea48-4458-b94f-2fe286c1ae53 req-7e62d814-cdce-4293-a76e-1fa9ab00dbbd service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c63a7b60-ea48-4458-b94f-2fe286c1ae53 req-7e62d814-cdce-4293-a76e-1fa9ab00dbbd service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c63a7b60-ea48-4458-b94f-2fe286c1ae53 req-7e62d814-cdce-4293-a76e-1fa9ab00dbbd service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-c63a7b60-ea48-4458-b94f-2fe286c1ae53 req-7e62d814-cdce-4293-a76e-1fa9ab00dbbd service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:51 user nova-compute[75258]: WARNING nova.compute.manager [req-c63a7b60-ea48-4458-b94f-2fe286c1ae53 req-7e62d814-cdce-4293-a76e-1fa9ab00dbbd service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:42:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:52 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance destroyed successfully.
Nov 14 12:42:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:53 user nova-compute[75258]: WARNING nova.compute.manager [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:42:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:53 user nova-compute[75258]: WARNING nova.compute.manager [req-41fcef6d-c9b3-48e7-97d5-6935c29ec218 req-95c8dcbf-6e1d-4b0d-a7f8-cfe4b0796c8d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:42:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e37df94e-69d9-4c09-9766-748ac622e570 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:42:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-f1d8d556-465a-45b3-a3c7-ae16d0923e48 req-731795a5-6b0d-4f09-92df-25bde1533b39 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f1d8d556-465a-45b3-a3c7-ae16d0923e48 req-731795a5-6b0d-4f09-92df-25bde1533b39 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:42:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f1d8d556-465a-45b3-a3c7-ae16d0923e48 req-731795a5-6b0d-4f09-92df-25bde1533b39 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:42:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f1d8d556-465a-45b3-a3c7-ae16d0923e48 req-731795a5-6b0d-4f09-92df-25bde1533b39 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:42:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-f1d8d556-465a-45b3-a3c7-ae16d0923e48 req-731795a5-6b0d-4f09-92df-25bde1533b39 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:42:55 user nova-compute[75258]: WARNING nova.compute.manager [req-f1d8d556-465a-45b3-a3c7-ae16d0923e48 req-731795a5-6b0d-4f09-92df-25bde1533b39 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state None.
Nov 14 12:42:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-changed-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:42:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Refreshing instance network info cache due to event network-changed-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:42:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:42:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:42:57 user nova-compute[75258]: DEBUG nova.network.neutron [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Refreshing network info cache for port f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:42:58 user nova-compute[75258]: DEBUG nova.network.neutron [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updated VIF entry in instance network info cache for port f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:42:58 user nova-compute[75258]: DEBUG nova.network.neutron [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:42:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ec875c53-b3be-4b2a-ad6d-b14227310c13 req-545d688d-260b-4803-889c-17c94aab3a50 service nova] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:42:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:42:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 is timed out.
Nov 14 12:43:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully detached device vdb from instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8 from the live domain config.
Nov 14 12:43:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFJDzNYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:43:01 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb3c376-1c27-49c8-b3d4-ada05737ceb4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:43:01 user nova-compute[75258]: No targets found.
Nov 14 12:43:01 user nova-compute[75258]: iSNS:
Nov 14 12:43:01 user nova-compute[75258]: No targets found.
Nov 14 12:43:01 user nova-compute[75258]: STATIC:
Nov 14 12:43:01 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:43:01 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:01 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:01 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3
Nov 14 12:43:01 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:01 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:01 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:43:01 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:01 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:01 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe
Nov 14 12:43:01 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:01 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:01 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:43:01 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:01 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:01 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:43:01 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:01 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:01 user nova-compute[75258]: FIRMWARE:
Nov 14 12:43:01 user nova-compute[75258]: No targets found.
Nov 14 12:43:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:43:01 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:43:01 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6508b8b9-eb8d-4225-a125-60779f67a880]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60c5886-6fe6-40ff-b2df-f83e0a588264]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:43:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 (non-flash)
Nov 14 12:43:01 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:43:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7d6dd0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3'): ({'sdi'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Removing single pathed devices sdi {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edd9a014-6122-4c25-9f72-44a38c346bb4]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdi" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[295bc5b4-e0ea-4396-a2ce-a042c47cf61c]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Flushing IO for device /dev/sdi {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[537abb4b-a81d-4d44-a163-35b5eb51e93c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdi/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdi/device/delete" returned: 0 in 0.046s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a1fc19a-d9a2-4fbf-a4a3-dc208f13e945]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Checking to see if SCSI volumes sdi have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] SCSI volumes sdi have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2a47cd-f900-480a-9ab6-4875cbfee0b6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[625254e7-8869-41ae-8176-5d22eef2e296]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260]
Nov 14 12:43:01 user nova-compute[75258]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3, portal: 172.16.0.220,3260] successful.
Nov 14 12:43:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff100ac-6e96-4a6f-b6e6-fa9aeb34111c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== disconnect_volume: return (346ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:43:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'flavor' on Instance uuid e4f541b4-6f64-4e49-9d46-5806aeba8ad8 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7728cad5-36cd-4420-ac4a-40c4c46be971 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.779s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 21.671s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:02 user nova-compute[75258]: INFO nova.compute.manager [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Terminating instance
Nov 14 12:43:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-511245e3-6946-41f2-947a-4d190f0f2c57 req-ce516f33-f52f-4a12-9271-842f74e1200e service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-vif-unplugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-511245e3-6946-41f2-947a-4d190f0f2c57 req-ce516f33-f52f-4a12-9271-842f74e1200e service nova] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-511245e3-6946-41f2-947a-4d190f0f2c57 req-ce516f33-f52f-4a12-9271-842f74e1200e service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-511245e3-6946-41f2-947a-4d190f0f2c57 req-ce516f33-f52f-4a12-9271-842f74e1200e service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-511245e3-6946-41f2-947a-4d190f0f2c57 req-ce516f33-f52f-4a12-9271-842f74e1200e service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] No waiting events found dispatching network-vif-unplugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-511245e3-6946-41f2-947a-4d190f0f2c57 req-ce516f33-f52f-4a12-9271-842f74e1200e service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-vif-unplugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Instance destroyed successfully.
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lazy-loading 'resources' on Instance uuid e4f541b4-6f64-4e49-9d46-5806aeba8ad8 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:40:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1318053202',display_name='tempest-VolumesSnapshotTestJSON-instance-1318053202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1318053202',id=18,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCCnPb0eScVzwWooO5xCIr5T/s67Jkv4TPKqZx/p/3T//cmaUzOCpw5c/yA5Gx97VsulJEkBhrCFYTHnKqG4OJKkI3cSE59PsgfyXnRd8E2ksXzEkny41uSsVBUQzGB20A==',key_name='tempest-keypair-1198725233',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:40:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='b6be68d1d7154b8d9ca0a763c1d65617',ramdisk_id='',reservation_id='r-0q31yb96',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-1911480704',owner_user_name='tempest-VolumesSnapshotTestJSON-1911480704-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:40:41Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d81b2cffea334578955e14613341e85e',uuid=e4f541b4-6f64-4e49-9d46-5806aeba8ad8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converting VIF {"id": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "address": "fa:16:3e:4a:ce:a7", "network": {"id": "53b46f3d-404d-420f-a696-408dd81b95f4", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-1592792899-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.195", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "b6be68d1d7154b8d9ca0a763c1d65617", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapaf2f80aa-4b", "ovs_interfaceid": "af2f80aa-4b8b-4ba8-9b35-6ac29459178b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ce:a7,bridge_name='br-int',has_traffic_filtering=True,id=af2f80aa-4b8b-4ba8-9b35-6ac29459178b,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2f80aa-4b') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_vif [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ce:a7,bridge_name='br-int',has_traffic_filtering=True,id=af2f80aa-4b8b-4ba8-9b35-6ac29459178b,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2f80aa-4b') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapaf2f80aa-4b, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b96292cf-a674-4393-8096-4875ee1f13f7) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:03 user nova-compute[75258]: INFO os_vif [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4a:ce:a7,bridge_name='br-int',has_traffic_filtering=True,id=af2f80aa-4b8b-4ba8-9b35-6ac29459178b,network=Network(53b46f3d-404d-420f-a696-408dd81b95f4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapaf2f80aa-4b')
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pFJDzNYf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdi'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:43:03 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c753cd8-7a7b-4cc4-bdc9-cdb486745066]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:43:03 user nova-compute[75258]: No targets found.
Nov 14 12:43:03 user nova-compute[75258]: iSNS:
Nov 14 12:43:03 user nova-compute[75258]: No targets found.
Nov 14 12:43:03 user nova-compute[75258]: STATIC:
Nov 14 12:43:03 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:43:03 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:03 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:03 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:43:03 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:03 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:03 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe
Nov 14 12:43:03 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:03 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:03 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:43:03 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:03 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:03 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:43:03 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:03 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:03 user nova-compute[75258]: FIRMWARE:
Nov 14 12:43:03 user nova-compute[75258]: No targets found.
Nov 14 12:43:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:43:03 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:43:03 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4b229cda-d802-47a3-b855-d97521ece1d3', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff49cb65-f2bf-4f27-9fde-e22b904114b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02d776e5-7683-4ab5-95f3-a8048cc22c76]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:43:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:03 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:43:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7d7640>, {}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Disconnecting from: [] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] <== disconnect_volume: return (75ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:43:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Deleting instance files /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8_del
Nov 14 12:43:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Deletion of /opt/stack/data/nova/instances/e4f541b4-6f64-4e49-9d46-5806aeba8ad8_del complete
Nov 14 12:43:03 user nova-compute[75258]: INFO nova.compute.manager [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Took 0.96 seconds to destroy the instance on the hypervisor.
Nov 14 12:43:03 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:43:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:04 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Took 0.81 seconds to deallocate network for instance.
Nov 14 12:43:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-ec6cb87d-9535-4809-81cf-78e636900f89 req-edf8fe71-74da-4b70-8289-4c7ed34ccfc4 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-vif-deleted-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:04 user nova-compute[75258]: WARNING nova.volume.cinder [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Attachment f397eeed-0262-428a-908a-a37b2c057c1e does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = f397eeed-0262-428a-908a-a37b2c057c1e. (HTTP 404) (Request-ID: req-16ff0631-0f15-435e-95b0-350c42ee15fa)
Nov 14 12:43:04 user nova-compute[75258]: INFO nova.compute.manager [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Took 0.04 seconds to detach 1 volumes for instance.
Nov 14 12:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:04 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 12:43:04 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 12:43:04 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 12:43:04 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 12:43:04 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-ffd0b262-d43a-4baa-8d3c-4771a1ebd0d4 req-72df9b88-ba9a-4f6e-950b-b72a89296970 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received event network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ffd0b262-d43a-4baa-8d3c-4771a1ebd0d4 req-72df9b88-ba9a-4f6e-950b-b72a89296970 service nova] Acquiring lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ffd0b262-d43a-4baa-8d3c-4771a1ebd0d4 req-72df9b88-ba9a-4f6e-950b-b72a89296970 service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ffd0b262-d43a-4baa-8d3c-4771a1ebd0d4 req-72df9b88-ba9a-4f6e-950b-b72a89296970 service nova] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-ffd0b262-d43a-4baa-8d3c-4771a1ebd0d4 req-72df9b88-ba9a-4f6e-950b-b72a89296970 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] No waiting events found dispatching network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:05 user nova-compute[75258]: WARNING nova.compute.manager [req-ffd0b262-d43a-4baa-8d3c-4771a1ebd0d4 req-72df9b88-ba9a-4f6e-950b-b72a89296970 service nova] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] Received unexpected event network-vif-plugged-af2f80aa-4b8b-4ba8-9b35-6ac29459178b for instance with vm_state deleted and task_state None.
Nov 14 12:43:05 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.698s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:05 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Deleted allocations for instance e4f541b4-6f64-4e49-9d46-5806aeba8ad8
Nov 14 12:43:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e63c94fd-cb54-4b8d-bda7-96677fbfc3f2 tempest-VolumesSnapshotTestJSON-1911480704 tempest-VolumesSnapshotTestJSON-1911480704-project-member] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.776s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 17.997s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:05 user nova-compute[75258]: INFO nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e4f541b4-6f64-4e49-9d46-5806aeba8ad8] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 14 12:43:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "e4f541b4-6f64-4e49-9d46-5806aeba8ad8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-changed-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing instance network info cache due to event network-changed-7e00c907-5dd9-4bd6-b39d-301b32d2db1d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] Acquiring lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] Acquired lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:43:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Refreshing network info cache for port 7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:43:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG nova.network.neutron [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updated VIF entry in instance network info cache for port 7e00c907-5dd9-4bd6-b39d-301b32d2db1d. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG nova.network.neutron [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [{"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58ba6010-8fef-4525-b391-7e38d1d660fd req-70cfb997-4f47-461c-bbea-2e2c9bbe5231 service nova] Releasing lock "refresh_cache-20460ef8-3184-40a3-9778-99a570da24f3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "20460ef8-3184-40a3-9778-99a570da24f3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:08 user nova-compute[75258]: INFO nova.compute.manager [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Terminating instance
Nov 14 12:43:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-07edb2aa-1922-4ecb-a428-fb725308a886 req-c43b79a2-7020-459f-bfce-7856481fee0f service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-07edb2aa-1922-4ecb-a428-fb725308a886 req-c43b79a2-7020-459f-bfce-7856481fee0f service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-07edb2aa-1922-4ecb-a428-fb725308a886 req-c43b79a2-7020-459f-bfce-7856481fee0f service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-07edb2aa-1922-4ecb-a428-fb725308a886 req-c43b79a2-7020-459f-bfce-7856481fee0f service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-07edb2aa-1922-4ecb-a428-fb725308a886 req-c43b79a2-7020-459f-bfce-7856481fee0f service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-unplugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-07edb2aa-1922-4ecb-a428-fb725308a886 req-c43b79a2-7020-459f-bfce-7856481fee0f service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-unplugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:09 user nova-compute[75258]: WARNING nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-7e00c907-5dd9-4bd6-b39d-301b32d2db1d for instance with vm_state active and task_state deleting.
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-unplugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:09 user nova-compute[75258]: WARNING nova.compute.manager [req-73a65464-27fb-475b-b82a-fc92ee1f1d07 req-baca2e3e-ff34-4e59-85a4-ec4691e7f51e service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-44cc718e-41e3-4891-96b9-345e3c3c9a10 for instance with vm_state active and task_state deleting.
Nov 14 12:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:09 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Instance destroyed successfully.
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.objects.instance [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lazy-loading 'resources' on Instance uuid 20460ef8-3184-40a3-9778-99a570da24f3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:b4:98,bridge_name='br-int',has_traffic_filtering=True,id=7e00c907-5dd9-4bd6-b39d-301b32d2db1d,network=Network(75d9aeb4-8798-4447-8dc9-56db1cb4bcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e00c907-5d') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:b4:98,bridge_name='br-int',has_traffic_filtering=True,id=7e00c907-5dd9-4bd6-b39d-301b32d2db1d,network=Network(75d9aeb4-8798-4447-8dc9-56db1cb4bcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e00c907-5d') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7e00c907-5d, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=329de8eb-5745-41b4-aacf-c9eba21885e0) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 10574d06-4168-43c2-bf6b-22a1a55febab is timed out.
Nov 14 12:43:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Successfully detached device vdb from instance 10574d06-4168-43c2-bf6b-22a1a55febab from the live domain config.
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HnZXGyru', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'da5e7100-0506-471f-9928-c95791152cfe'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:43:10 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: INFO os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:b4:98,bridge_name='br-int',has_traffic_filtering=True,id=7e00c907-5dd9-4bd6-b39d-301b32d2db1d,network=Network(75d9aeb4-8798-4447-8dc9-56db1cb4bcf9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7e00c907-5d')
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e2:76:cb,bridge_name='br-int',has_traffic_filtering=True,id=44cc718e-41e3-4891-96b9-345e3c3c9a10,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44cc718e-41') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:76:cb,bridge_name='br-int',has_traffic_filtering=True,id=44cc718e-41e3-4891-96b9-345e3c3c9a10,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44cc718e-41') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap44cc718e-41, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[567ca5fb-14bb-40b7-882c-28af76cb07e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:43:10 user nova-compute[75258]: No targets found.
Nov 14 12:43:10 user nova-compute[75258]: iSNS:
Nov 14 12:43:10 user nova-compute[75258]: No targets found.
Nov 14 12:43:10 user nova-compute[75258]: STATIC:
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: FIRMWARE:
Nov 14 12:43:10 user nova-compute[75258]: No targets found.
Nov 14 12:43:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:43:10 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:43:10 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a4f378-224f-4fa8-aa47-52126e0cc528]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81f92065-2fec-4199-a353-a8f685511697) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[788dd6ce-bcaa-4e4f-8284-b2458877b71a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:43:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe (non-flash)
Nov 14 12:43:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7d51b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d848d592-ef02-4849-9959-dad983971efb]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: INFO os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e2:76:cb,bridge_name='br-int',has_traffic_filtering=True,id=44cc718e-41e3-4891-96b9-345e3c3c9a10,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap44cc718e-41')
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=154ae39d-bfc2-411f-98a9-9f4f5495fc2a,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154ae39d-bf') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=154ae39d-bfc2-411f-98a9-9f4f5495fc2a,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154ae39d-bf') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap154ae39d-bf, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae10c44-4c0d-48d5-a370-cde3bf4d2782]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c570b1-e411-420d-add3-d711cc7e037b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f944cc33-65e0-4500-8008-c8bbfab619d2) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8d6f6d0-7120-4ea0-91f5-612ecb32b438]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:10 user nova-compute[75258]: INFO os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:ac:d8,bridge_name='br-int',has_traffic_filtering=True,id=154ae39d-bfc2-411f-98a9-9f4f5495fc2a,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap154ae39d-bf')
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:96:61,bridge_name='br-int',has_traffic_filtering=True,id=2feaa2c6-358f-4218-b9e7-cd675102b831,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2feaa2c6-35') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:96:61,bridge_name='br-int',has_traffic_filtering=True,id=2feaa2c6-358f-4218-b9e7-cd675102b831,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2feaa2c6-35') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2feaa2c6-35, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a468b5b4-e8f4-4727-a51f-eb385037f5bc]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4ae1f2cc-94cb-43c5-bbfb-6fc84e4b0f06) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[da5f8c6e-207a-4883-8b29-7cd598337e97]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260]
Nov 14 12:43:10 user nova-compute[75258]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe, portal: 172.16.0.220,3260] successful.
Nov 14 12:43:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: INFO os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:96:61,bridge_name='br-int',has_traffic_filtering=True,id=2feaa2c6-358f-4218-b9e7-cd675102b831,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2feaa2c6-35')
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ed:d1,bridge_name='br-int',has_traffic_filtering=True,id=e966ab8a-3429-4bc8-ac26-9e67b3ddb44b,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape966ab8a-34') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ed:d1,bridge_name='br-int',has_traffic_filtering=True,id=e966ab8a-3429-4bc8-ac26-9e67b3ddb44b,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape966ab8a-34') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape966ab8a-34, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:da5e7100-0506-471f-9928-c95791152cfe -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[62405ae5-3419-490a-8314-1b70e32b6f90]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.371s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] <== disconnect_volume: return (372ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=37e3aaab-8c9d-48ef-b2a0-e0bf6279c5e7) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: INFO os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0b:ed:d1,bridge_name='br-int',has_traffic_filtering=True,id=e966ab8a-3429-4bc8-ac26-9e67b3ddb44b,network=Network(466270e6-ba67-41bc-a4c9-b60e25fcd296),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape966ab8a-34')
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "address": "fa:16:3e:77:2c:08", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0914c675-6b", "ovs_interfaceid": "0914c675-6bf9-48cd-8ab0-f2426ffda9c7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:2c:08,bridge_name='br-int',has_traffic_filtering=True,id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914c675-6b') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:2c:08,bridge_name='br-int',has_traffic_filtering=True,id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914c675-6b') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0914c675-6b, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=225d37dc-ee76-42fd-a8ee-81660c27ca9b) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: INFO os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:2c:08,bridge_name='br-int',has_traffic_filtering=True,id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0914c675-6b')
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-11-14T12:41:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1355306843',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1355306843',id=20,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDipkp8gEQhoQGClej9cP1oQbPxtw3qlkHSIyjtGZ7SivIkgVeUZVP8S3kiY99C0C8jBeU5nuvEFoHmjnRkuaGGWIT6IxwzqfCxGyUyDGnpSr9xn7GLI9jrE7VZH7kfbIA==',key_name='tempest-keypair-260464472',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='944aa8964e2d495cafdaf0eef5b61861',ramdisk_id='',reservation_id='r-22yeqtsc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-145599604',owner_user_name='tempest-TaggedBootDevicesTest-145599604-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:41:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='73d464847a1f44e38f112a5f6463abaf',uuid=20460ef8-3184-40a3-9778-99a570da24f3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converting VIF {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=a775c9a7-fe67-46da-be05-32d36f2c71f9,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa775c9a7-fe') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=a775c9a7-fe67-46da-be05-32d36f2c71f9,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa775c9a7-fe') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa775c9a7-fe, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8e6f79e8-6b5b-47ed-a1b4-d4c2ccf9713b) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:10 user nova-compute[75258]: INFO os_vif [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:69:81:4b,bridge_name='br-int',has_traffic_filtering=True,id=a775c9a7-fe67-46da-be05-32d36f2c71f9,network=Network(41d6f265-062d-4661-a92b-e0975fcde7ac),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa775c9a7-fe')
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QHhGOugF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:43:10 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9fbb64-0f6d-4c2b-b8cd-47df86a30ef0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:43:10 user nova-compute[75258]: No targets found.
Nov 14 12:43:10 user nova-compute[75258]: iSNS:
Nov 14 12:43:10 user nova-compute[75258]: No targets found.
Nov 14 12:43:10 user nova-compute[75258]: STATIC:
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:43:10 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:10 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:10 user nova-compute[75258]: FIRMWARE:
Nov 14 12:43:10 user nova-compute[75258]: No targets found.
Nov 14 12:43:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:43:10 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:43:10 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0629e58-64b2-4fa7-bcf5-66fee9ae17eb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dcdd9c4-d73e-43ce-aa83-fbc2db4c722e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:10 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:10 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b430c790>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4247d105-86df-4e32-90b9-6777dfb30bab]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1b4b57-cc8d-4a19-a456-2f1802c48e49]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2db8c2-edbf-425b-9c6e-717e95f411b8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:10 user nova-compute[75258]: WARNING nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-154ae39d-bfc2-411f-98a9-9f4f5495fc2a for instance with vm_state active and task_state deleting.
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-unplugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:10 user nova-compute[75258]: WARNING nova.compute.manager [req-42cbbf53-f5c7-4ef2-977a-8220f273411f req-25db069c-424f-4935-bfc9-b047e00df7b0 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-a775c9a7-fe67-46da-be05-32d36f2c71f9 for instance with vm_state active and task_state deleting.
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.051s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fd13a02-3df3-40d0-802c-5e7f664cc70b]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b56c7874-da47-4cbf-95eb-c20fbd165abc]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f9e8bb3-eb96-4238-88fd-aa21d86d771e]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260]
Nov 14 12:43:11 user nova-compute[75258]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a, portal: 172.16.0.220,3260] successful.
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cac3e17d-4dab-44a8-a88a-572c7a82544a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8785b7e-e7ef-48ca-a74c-97203e273615]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== disconnect_volume: return (373ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SuEOdZsc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:43:11 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[572aec4b-fccf-45b9-9eca-bc6f4d6d2830]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:43:11 user nova-compute[75258]: No targets found.
Nov 14 12:43:11 user nova-compute[75258]: iSNS:
Nov 14 12:43:11 user nova-compute[75258]: No targets found.
Nov 14 12:43:11 user nova-compute[75258]: STATIC:
Nov 14 12:43:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:43:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80
Nov 14 12:43:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:43:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:11 user nova-compute[75258]: FIRMWARE:
Nov 14 12:43:11 user nova-compute[75258]: No targets found.
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:43:11 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:43:11 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[870dcf05-6a92-4796-81f1-e24ef9fbedcb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[494514f6-2fc3-47bb-97c5-a967e575375e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:11 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:11 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:11 user nova-compute[75258]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 (non-flash)
Nov 14 12:43:11 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b430d630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[165e3333-9a51-4bb8-a7db-255d7e4b9a77]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18e9fd9b-d1b7-4885-8dae-59a1c9950391]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cf2b8d1-6600-4184-9c9c-19e3a59b9c53]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-unplugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-2feaa2c6-358f-4218-b9e7-cd675102b831 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:11 user nova-compute[75258]: WARNING nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-2feaa2c6-358f-4218-b9e7-cd675102b831 for instance with vm_state active and task_state deleting.
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-unplugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:11 user nova-compute[75258]: WARNING nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b for instance with vm_state active and task_state deleting.
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-unplugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-unplugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Acquiring lock "20460ef8-3184-40a3-9778-99a570da24f3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] Lock "20460ef8-3184-40a3-9778-99a570da24f3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] No waiting events found dispatching network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:11 user nova-compute[75258]: WARNING nova.compute.manager [req-5a23c03f-8146-4692-b2ab-360448de4df4 req-a4730c78-0d7b-4108-af2c-38201d6d8916 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received unexpected event network-vif-plugged-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 for instance with vm_state active and task_state deleting.
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.037s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[efd0378b-1648-4174-998f-9190a427858f]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[59eeaf41-8b48-4761-bf01-9f8de52122d2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[104f85d9-1032-4595-ae55-35d0bb736342]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260]
Nov 14 12:43:11 user nova-compute[75258]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80, portal: 172.16.0.220,3260] successful.
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2569e17f-4313-4d2f-90ff-e347f42bcc80 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78989984-2b0c-498c-b2df-ff640ca2dc75]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.346s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== disconnect_volume: return (347ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'qfiPSukC', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:43:11 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lazy-loading 'flavor' on Instance uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe985d4e-e79a-4d97-8eee-6242a81a0ab4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:43:11 user nova-compute[75258]: No targets found.
Nov 14 12:43:11 user nova-compute[75258]: iSNS:
Nov 14 12:43:11 user nova-compute[75258]: No targets found.
Nov 14 12:43:11 user nova-compute[75258]: STATIC:
Nov 14 12:43:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:43:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a
Nov 14 12:43:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:43:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:43:11 user nova-compute[75258]: FIRMWARE:
Nov 14 12:43:11 user nova-compute[75258]: No targets found.
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:43:11 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:43:11 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b46d5ea-5eab-4350-99c0-93961c57b6ce]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c70b2cb6-0f06-4b39-98c0-d5e678eafb73 tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.913s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a48b100-a5e5-4951-b0c8-774a8655697b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:11 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:43:11 user nova-compute[75258]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a (non-flash)
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7d6440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a'): ({'sdf'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Removing single pathed devices sdf {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d06bc5bf-6db8-48f1-84fa-a099bfdc9958]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2111677-a5ae-46ae-91ce-afd5062df1aa]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Flushing IO for device /dev/sdf {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c74506bf-1805-4744-831c-cb0c57804d04]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8e08679-6c0f-4a76-bb31-ffbc35d5dad5]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d3fe46-ef95-4da0-abe8-237a67ca1588]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38e278b7-bd80-44f5-943d-73d52efada86]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260]
Nov 14 12:43:11 user nova-compute[75258]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a, portal: 172.16.0.220,3260] successful.
Nov 14 12:43:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ffa8f0a2-7773-4cee-9572-9abf40acf10a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcac9999-ebf4-4a83-837e-f36f4c021f05]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.333s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] <== disconnect_volume: return (334ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:43:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Deleting instance files /opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3_del
Nov 14 12:43:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Deletion of /opt/stack/data/nova/instances/20460ef8-3184-40a3-9778-99a570da24f3_del complete
Nov 14 12:43:11 user nova-compute[75258]: INFO nova.compute.manager [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Took 3.62 seconds to destroy the instance on the hypervisor.
Nov 14 12:43:11 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:43:11 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:43:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:43:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ac186509-f835-453a-b683-c6d3901babba] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ac186509-f835-453a-b683-c6d3901babba] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a1bdd7d-f853-485b-a3fa-c48bdd81be22 req-862ed8e6-f013-4de4-959f-f232b150a77d service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-deleted-0914c675-6bf9-48cd-8ab0-f2426ffda9c7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:13 user nova-compute[75258]: INFO nova.compute.manager [req-5a1bdd7d-f853-485b-a3fa-c48bdd81be22 req-862ed8e6-f013-4de4-959f-f232b150a77d service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Neutron deleted interface 0914c675-6bf9-48cd-8ab0-f2426ffda9c7; detaching it from the instance and deleting it from the info cache
Nov 14 12:43:13 user nova-compute[75258]: DEBUG nova.network.neutron [req-5a1bdd7d-f853-485b-a3fa-c48bdd81be22 req-862ed8e6-f013-4de4-959f-f232b150a77d service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [{"id": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "address": "fa:16:3e:8f:b4:98", "network": {"id": "75d9aeb4-8798-4447-8dc9-56db1cb4bcf9", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-11094522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.204", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7e00c907-5d", "ovs_interfaceid": "7e00c907-5dd9-4bd6-b39d-301b32d2db1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "address": "fa:16:3e:e2:76:cb", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.241", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap44cc718e-41", "ovs_interfaceid": "44cc718e-41e3-4891-96b9-345e3c3c9a10", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "address": "fa:16:3e:5f:ac:d8", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.29", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap154ae39d-bf", "ovs_interfaceid": "154ae39d-bfc2-411f-98a9-9f4f5495fc2a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2feaa2c6-358f-4218-b9e7-cd675102b831", "address": "fa:16:3e:25:96:61", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.41", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2feaa2c6-35", "ovs_interfaceid": "2feaa2c6-358f-4218-b9e7-cd675102b831", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "address": "fa:16:3e:0b:ed:d1", "network": {"id": "466270e6-ba67-41bc-a4c9-b60e25fcd296", "bridge": "br-int", "label": "tempest-device-tagging-net1-1754010907", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.90", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape966ab8a-34", "ovs_interfaceid": "e966ab8a-3429-4bc8-ac26-9e67b3ddb44b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "address": "fa:16:3e:69:81:4b", "network": {"id": "41d6f265-062d-4661-a92b-e0975fcde7ac", "bridge": "br-int", "label": "tempest-device-tagging-net2-783779226", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "944aa8964e2d495cafdaf0eef5b61861", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa775c9a7-fe", "ovs_interfaceid": "a775c9a7-fe67-46da-be05-32d36f2c71f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-5a1bdd7d-f853-485b-a3fa-c48bdd81be22 req-862ed8e6-f013-4de4-959f-f232b150a77d service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Detach interface failed, port_id=0914c675-6bf9-48cd-8ab0-f2426ffda9c7, reason: Instance 20460ef8-3184-40a3-9778-99a570da24f3 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:43:14 user nova-compute[75258]: INFO nova.compute.claims [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Claim successful on node user
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.440s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:43:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.policy [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '974df2b5a20f414eadb9e84383523e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dc8f5ff4bf4a4788a2f7ec14b844f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:15 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Took 3.24 seconds to deallocate network for instance.
Nov 14 12:43:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:43:15 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Creating image(s)
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "/opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "/opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "/opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.004s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.302s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-a906b819-0d03-4722-94b4-003ffcdbeca0 req-d2b0da16-fda9-4bff-bfc7-aa1ec2ead8b3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-deleted-e966ab8a-3429-4bc8-ac26-9e67b3ddb44b {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-a906b819-0d03-4722-94b4-003ffcdbeca0 req-d2b0da16-fda9-4bff-bfc7-aa1ec2ead8b3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-deleted-a775c9a7-fe67-46da-be05-32d36f2c71f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-a906b819-0d03-4722-94b4-003ffcdbeca0 req-d2b0da16-fda9-4bff-bfc7-aa1ec2ead8b3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-deleted-2feaa2c6-358f-4218-b9e7-cd675102b831 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-a906b819-0d03-4722-94b4-003ffcdbeca0 req-d2b0da16-fda9-4bff-bfc7-aa1ec2ead8b3 service nova] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Received event network-vif-deleted-7e00c907-5dd9-4bd6-b39d-301b32d2db1d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk 1073741824" returned: 0 in 0.056s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.363s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Successfully created port: 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.417s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:43:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:43:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8396MB free_disk=25.318328857421875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 10574d06-4168-43c2-bf6b-22a1a55febab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 20460ef8-3184-40a3-9778-99a570da24f3 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Cannot resize image /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Ensure instance console log exists: /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Successfully updated port: 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquired lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-changed-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Refreshing instance network info cache due to event network-changed-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] Acquiring lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Releasing lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Instance network_info: |[{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] Acquired lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Refreshing network info cache for port 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:43:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Start _get_guest_xml network_info=[{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:43:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:43:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1259879842',display_name='tempest-ServerActionsTestOtherA-server-1259879842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1259879842',id=21,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-mjtjmlw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=dc99e2bd-9c7e-4b04-a92a-8be01f6db176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:92,bridge_name='br-int',has_traffic_filtering=True,id=7b7400d1-ea22-4c63-8d3d-f4040b0eca9d,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7400d1-ea') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'pci_devices' on Instance uuid dc99e2bd-9c7e-4b04-a92a-8be01f6db176 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:43:17 user nova-compute[75258]:   <uuid>dc99e2bd-9c7e-4b04-a92a-8be01f6db176</uuid>
Nov 14 12:43:17 user nova-compute[75258]:   <name>instance-00000015</name>
Nov 14 12:43:17 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:43:17 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:43:17 user nova-compute[75258]:   <metadata>
Nov 14 12:43:17 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:43:17 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:43:17 user nova-compute[75258]:       <nova:name>tempest-ServerActionsTestOtherA-server-1259879842</nova:name>
Nov 14 12:43:17 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:43:16</nova:creationTime>
Nov 14 12:43:17 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:43:17 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:43:17 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:43:17 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:43:17 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:43:17 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:43:17 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:43:17 user nova-compute[75258]:       <nova:owner>
Nov 14 12:43:17 user nova-compute[75258]:         <nova:user uuid="974df2b5a20f414eadb9e84383523e4f">tempest-ServerActionsTestOtherA-1553354563-project-member</nova:user>
Nov 14 12:43:17 user nova-compute[75258]:         <nova:project uuid="a6dc8f5ff4bf4a4788a2f7ec14b844f5">tempest-ServerActionsTestOtherA-1553354563</nova:project>
Nov 14 12:43:17 user nova-compute[75258]:       </nova:owner>
Nov 14 12:43:17 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:43:17 user nova-compute[75258]:       <nova:ports>
Nov 14 12:43:17 user nova-compute[75258]:         <nova:port uuid="7b7400d1-ea22-4c63-8d3d-f4040b0eca9d">
Nov 14 12:43:17 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 12:43:17 user nova-compute[75258]:         </nova:port>
Nov 14 12:43:17 user nova-compute[75258]:       </nova:ports>
Nov 14 12:43:17 user nova-compute[75258]:     </nova:instance>
Nov 14 12:43:17 user nova-compute[75258]:   </metadata>
Nov 14 12:43:17 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:43:17 user nova-compute[75258]:     <system>
Nov 14 12:43:17 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:43:17 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:43:17 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:43:17 user nova-compute[75258]:       <entry name="serial">dc99e2bd-9c7e-4b04-a92a-8be01f6db176</entry>
Nov 14 12:43:17 user nova-compute[75258]:       <entry name="uuid">dc99e2bd-9c7e-4b04-a92a-8be01f6db176</entry>
Nov 14 12:43:17 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:43:17 user nova-compute[75258]:     </system>
Nov 14 12:43:17 user nova-compute[75258]:   </sysinfo>
Nov 14 12:43:17 user nova-compute[75258]:   <os>
Nov 14 12:43:17 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:43:17 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:43:17 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:43:17 user nova-compute[75258]:   </os>
Nov 14 12:43:17 user nova-compute[75258]:   <features>
Nov 14 12:43:17 user nova-compute[75258]:     <acpi/>
Nov 14 12:43:17 user nova-compute[75258]:     <apic/>
Nov 14 12:43:17 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:43:17 user nova-compute[75258]:   </features>
Nov 14 12:43:17 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:43:17 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:43:17 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:43:17 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:43:17 user nova-compute[75258]:   </clock>
Nov 14 12:43:17 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:43:17 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:43:17 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:43:17 user nova-compute[75258]:   </cpu>
Nov 14 12:43:17 user nova-compute[75258]:   <devices>
Nov 14 12:43:17 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:43:17 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:43:17 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk"/>
Nov 14 12:43:17 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:43:17 user nova-compute[75258]:     </disk>
Nov 14 12:43:17 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:43:17 user nova-compute[75258]:       <mac address="fa:16:3e:b7:01:92"/>
Nov 14 12:43:17 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:43:17 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:43:17 user nova-compute[75258]:       <target dev="tap7b7400d1-ea"/>
Nov 14 12:43:17 user nova-compute[75258]:     </interface>
Nov 14 12:43:17 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:43:17 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/console.log" append="off"/>
Nov 14 12:43:17 user nova-compute[75258]:     </serial>
Nov 14 12:43:17 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:43:17 user nova-compute[75258]:     <video>
Nov 14 12:43:17 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:43:17 user nova-compute[75258]:     </video>
Nov 14 12:43:17 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:43:17 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:43:17 user nova-compute[75258]:     </rng>
Nov 14 12:43:17 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:43:17 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:43:17 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:43:17 user nova-compute[75258]:     </memballoon>
Nov 14 12:43:17 user nova-compute[75258]:   </devices>
Nov 14 12:43:17 user nova-compute[75258]: </domain>
Nov 14 12:43:17 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1259879842',display_name='tempest-ServerActionsTestOtherA-server-1259879842',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1259879842',id=21,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-mjtjmlw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:43:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=dc99e2bd-9c7e-4b04-a92a-8be01f6db176,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:92,bridge_name='br-int',has_traffic_filtering=True,id=7b7400d1-ea22-4c63-8d3d-f4040b0eca9d,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7400d1-ea') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG os_vif [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:92,bridge_name='br-int',has_traffic_filtering=True,id=7b7400d1-ea22-4c63-8d3d-f4040b0eca9d,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7400d1-ea') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e170b574-e75f-58bf-bc3c-4217064d1316', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7b7400d1-ea, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7b7400d1-ea, col_values=(('qos', UUID('07cc587f-7812-4201-93d8-f7930e89fb8a')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7b7400d1-ea, col_values=(('external_ids', {'iface-id': '7b7400d1-ea22-4c63-8d3d-f4040b0eca9d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b7:01:92', 'vm-uuid': 'dc99e2bd-9c7e-4b04-a92a-8be01f6db176'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:17 user nova-compute[75258]: INFO os_vif [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b7:01:92,bridge_name='br-int',has_traffic_filtering=True,id=7b7400d1-ea22-4c63-8d3d-f4040b0eca9d,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7400d1-ea')
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No VIF found with MAC fa:16:3e:b7:01:92, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updated VIF entry in instance network info cache for port 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-63d0d216-747b-4691-85d1-7dc0e5ba9162 req-7430ff5e-7d14-49c7-8189-b6a739684753 service nova] Releasing lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:43:17 user nova-compute[75258]: INFO nova.compute.manager [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] [instance: 20460ef8-3184-40a3-9778-99a570da24f3] Took 2.60 seconds to detach 3 volumes for instance.
Nov 14 12:43:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:43:17 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.300s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:18 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Deleted allocations for instance 20460ef8-3184-40a3-9778-99a570da24f3
Nov 14 12:43:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-731e1ff5-0a32-455b-a5b5-3bcba8df87e5 tempest-TaggedBootDevicesTest-145599604 tempest-TaggedBootDevicesTest-145599604-project-member] Lock "20460ef8-3184-40a3-9778-99a570da24f3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 9.966s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-5d42051e-bd3f-447e-ae4b-8d8277376d8d req-3aa9f8b4-d6c4-452c-bb0d-0f2871b4051d service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5d42051e-bd3f-447e-ae4b-8d8277376d8d req-3aa9f8b4-d6c4-452c-bb0d-0f2871b4051d service nova] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5d42051e-bd3f-447e-ae4b-8d8277376d8d req-3aa9f8b4-d6c4-452c-bb0d-0f2871b4051d service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5d42051e-bd3f-447e-ae4b-8d8277376d8d req-3aa9f8b4-d6c4-452c-bb0d-0f2871b4051d service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-5d42051e-bd3f-447e-ae4b-8d8277376d8d req-3aa9f8b4-d6c4-452c-bb0d-0f2871b4051d service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] No waiting events found dispatching network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:18 user nova-compute[75258]: WARNING nova.compute.manager [req-5d42051e-bd3f-447e-ae4b-8d8277376d8d req-3aa9f8b4-d6c4-452c-bb0d-0f2871b4051d service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received unexpected event network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d for instance with vm_state building and task_state spawning.
Nov 14 12:43:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:43:20 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Instance spawned successfully.
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-52036c17-8399-4480-a6c3-bab1c5d5795a req-7461e117-5dc4-425a-9d75-ae5b98b55898 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-52036c17-8399-4480-a6c3-bab1c5d5795a req-7461e117-5dc4-425a-9d75-ae5b98b55898 service nova] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-52036c17-8399-4480-a6c3-bab1c5d5795a req-7461e117-5dc4-425a-9d75-ae5b98b55898 service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-52036c17-8399-4480-a6c3-bab1c5d5795a req-7461e117-5dc4-425a-9d75-ae5b98b55898 service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-52036c17-8399-4480-a6c3-bab1c5d5795a req-7461e117-5dc4-425a-9d75-ae5b98b55898 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] No waiting events found dispatching network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:20 user nova-compute[75258]: WARNING nova.compute.manager [req-52036c17-8399-4480-a6c3-bab1c5d5795a req-7461e117-5dc4-425a-9d75-ae5b98b55898 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received unexpected event network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d for instance with vm_state building and task_state spawning.
Nov 14 12:43:20 user nova-compute[75258]: INFO nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Took 5.69 seconds to spawn the instance on the hypervisor.
Nov 14 12:43:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:43:20 user nova-compute[75258]: INFO nova.compute.manager [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Took 6.53 seconds to build instance.
Nov 14 12:43:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b6fd147-7c7d-4889-8ef1-ac90f3f16645 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.686s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:22 user nova-compute[75258]: INFO nova.compute.manager [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Terminating instance
Nov 14 12:43:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-3b8bb551-8512-47ef-b1a6-519ba61af260 req-49f0aaba-71cc-4db7-98d9-10790d3a4ed8 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-vif-unplugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3b8bb551-8512-47ef-b1a6-519ba61af260 req-49f0aaba-71cc-4db7-98d9-10790d3a4ed8 service nova] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3b8bb551-8512-47ef-b1a6-519ba61af260 req-49f0aaba-71cc-4db7-98d9-10790d3a4ed8 service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3b8bb551-8512-47ef-b1a6-519ba61af260 req-49f0aaba-71cc-4db7-98d9-10790d3a4ed8 service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-3b8bb551-8512-47ef-b1a6-519ba61af260 req-49f0aaba-71cc-4db7-98d9-10790d3a4ed8 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] No waiting events found dispatching network-vif-unplugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-3b8bb551-8512-47ef-b1a6-519ba61af260 req-49f0aaba-71cc-4db7-98d9-10790d3a4ed8 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-vif-unplugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Instance destroyed successfully.
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lazy-loading 'resources' on Instance uuid 80bea81e-2e5a-45d6-814a-44685e6e9d46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-1352315988',display_name='tempest-SnapshotDataIntegrityTests-server-1352315988',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-1352315988',id=10,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE957PgQRSggN8Dj86LMDAJEmx5ZsvwwbKLz3HalMrOS/jKtfo28/irUdbzNYxEpZAGWabAZuWzb7eMtuCeUM1yXWzQ+nzrwyMe7EkbBQ5aJVyt/6Yur+3v7Owg3LFSDsw==',key_name='tempest-keypair-407325897',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:37:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1cbbe47e1c0d4c94bf466112c32c6190',ramdisk_id='',reservation_id='r-njnaa7mw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-620622230',owner_user_name='tempest-SnapshotDataIntegrityTests-620622230-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:37:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='591974f996f143ca85705374086be774',uuid=80bea81e-2e5a-45d6-814a-44685e6e9d46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Converting VIF {"id": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "address": "fa:16:3e:e8:ff:7e", "network": {"id": "17ed6d09-f6ff-49c1-925a-3b359199bdc2", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-117567220-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.173", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1cbbe47e1c0d4c94bf466112c32c6190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7c006bb4-98", "ovs_interfaceid": "7c006bb4-98c0-4f9c-9367-d76bd2595e2e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ff:7e,bridge_name='br-int',has_traffic_filtering=True,id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e,network=Network(17ed6d09-f6ff-49c1-925a-3b359199bdc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c006bb4-98') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG os_vif [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ff:7e,bridge_name='br-int',has_traffic_filtering=True,id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e,network=Network(17ed6d09-f6ff-49c1-925a-3b359199bdc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c006bb4-98') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7c006bb4-98, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13b16f14-eee5-46c4-906d-a8a5804674ed) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:23 user nova-compute[75258]: INFO os_vif [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:ff:7e,bridge_name='br-int',has_traffic_filtering=True,id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e,network=Network(17ed6d09-f6ff-49c1-925a-3b359199bdc2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7c006bb4-98')
Nov 14 12:43:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Deleting instance files /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46_del
Nov 14 12:43:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Deletion of /opt/stack/data/nova/instances/80bea81e-2e5a-45d6-814a-44685e6e9d46_del complete
Nov 14 12:43:23 user nova-compute[75258]: INFO nova.compute.manager [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Took 1.00 seconds to destroy the instance on the hypervisor.
Nov 14 12:43:23 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:43:23 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:24 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Took 0.83 seconds to deallocate network for instance.
Nov 14 12:43:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-95a29b52-db67-4562-bcc4-e1bb89bfdd44 req-6e020165-7fd9-4370-852d-dab7bc8fffcb service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-vif-deleted-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:24 user nova-compute[75258]: INFO nova.compute.manager [req-95a29b52-db67-4562-bcc4-e1bb89bfdd44 req-6e020165-7fd9-4370-852d-dab7bc8fffcb service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Neutron deleted interface 7c006bb4-98c0-4f9c-9367-d76bd2595e2e; detaching it from the instance and deleting it from the info cache
Nov 14 12:43:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-95a29b52-db67-4562-bcc4-e1bb89bfdd44 req-6e020165-7fd9-4370-852d-dab7bc8fffcb service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-95a29b52-db67-4562-bcc4-e1bb89bfdd44 req-6e020165-7fd9-4370-852d-dab7bc8fffcb service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Detach interface failed, port_id=7c006bb4-98c0-4f9c-9367-d76bd2595e2e, reason: Instance 80bea81e-2e5a-45d6-814a-44685e6e9d46 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:43:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:24 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Deleted allocations for instance 80bea81e-2e5a-45d6-814a-44685e6e9d46
Nov 14 12:43:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-70ec27ba-abcb-46b0-b9b5-bd05b4e013c8 tempest-SnapshotDataIntegrityTests-620622230 tempest-SnapshotDataIntegrityTests-620622230-project-member] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.270s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-e1688fa3-39d8-4640-90ac-ff2b6d118476 req-d760f6bb-06af-480b-8f5c-094825fbf971 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received event network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e1688fa3-39d8-4640-90ac-ff2b6d118476 req-d760f6bb-06af-480b-8f5c-094825fbf971 service nova] Acquiring lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e1688fa3-39d8-4640-90ac-ff2b6d118476 req-d760f6bb-06af-480b-8f5c-094825fbf971 service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e1688fa3-39d8-4640-90ac-ff2b6d118476 req-d760f6bb-06af-480b-8f5c-094825fbf971 service nova] Lock "80bea81e-2e5a-45d6-814a-44685e6e9d46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-e1688fa3-39d8-4640-90ac-ff2b6d118476 req-d760f6bb-06af-480b-8f5c-094825fbf971 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] No waiting events found dispatching network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:25 user nova-compute[75258]: WARNING nova.compute.manager [req-e1688fa3-39d8-4640-90ac-ff2b6d118476 req-d760f6bb-06af-480b-8f5c-094825fbf971 service nova] [instance: 80bea81e-2e5a-45d6-814a-44685e6e9d46] Received unexpected event network-vif-plugged-7c006bb4-98c0-4f9c-9367-d76bd2595e2e for instance with vm_state deleted and task_state None.
Nov 14 12:43:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:39 user nova-compute[75258]: INFO nova.compute.manager [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Terminating instance
Nov 14 12:43:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-43a54f2b-f087-4278-98bf-158aae4337dd req-641574b6-c03f-43d0-8313-ea9f71020b13 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-vif-unplugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-43a54f2b-f087-4278-98bf-158aae4337dd req-641574b6-c03f-43d0-8313-ea9f71020b13 service nova] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-43a54f2b-f087-4278-98bf-158aae4337dd req-641574b6-c03f-43d0-8313-ea9f71020b13 service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-43a54f2b-f087-4278-98bf-158aae4337dd req-641574b6-c03f-43d0-8313-ea9f71020b13 service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-43a54f2b-f087-4278-98bf-158aae4337dd req-641574b6-c03f-43d0-8313-ea9f71020b13 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] No waiting events found dispatching network-vif-unplugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-43a54f2b-f087-4278-98bf-158aae4337dd req-641574b6-c03f-43d0-8313-ea9f71020b13 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-vif-unplugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Instance destroyed successfully.
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.objects.instance [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lazy-loading 'resources' on Instance uuid 10574d06-4168-43c2-bf6b-22a1a55febab {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:40:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-2117301397',display_name='tempest-TestVolumeSwap-server-2117301397',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-2117301397',id=17,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJkr2ZNHO2r5mSYG7DboXgIC3TRwy1xE6TMZ/g2s/M74knly9jctMQKwypUgEPX+1gxUQT4Ya8DKdNFL0WcGTqq3KJ98HiF2sM+6OsR0dRwzxgbG3PYEBUXM+uGeRr9K6g==',key_name='tempest-keypair-23334534',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:40:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ea036c5b20cf4a3f9083dbae82dc7f2d',ramdisk_id='',reservation_id='r-lpxjgfks',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-1946407222',owner_user_name='tempest-TestVolumeSwap-1946407222-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:40:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ce66d8c301347ce97b52c83b58a5cf0',uuid=10574d06-4168-43c2-bf6b-22a1a55febab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Converting VIF {"id": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "address": "fa:16:3e:78:d2:8b", "network": {"id": "1ae924d4-0297-4fd7-95cc-883a070c666b", "bridge": "br-int", "label": "tempest-TestVolumeSwap-727162895-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.54", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ea036c5b20cf4a3f9083dbae82dc7f2d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap48dbd1aa-44", "ovs_interfaceid": "48dbd1aa-4424-4a29-8054-5a5d8d53bf8a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=48dbd1aa-4424-4a29-8054-5a5d8d53bf8a,network=Network(1ae924d4-0297-4fd7-95cc-883a070c666b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbd1aa-44') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG os_vif [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=48dbd1aa-4424-4a29-8054-5a5d8d53bf8a,network=Network(1ae924d4-0297-4fd7-95cc-883a070c666b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbd1aa-44') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap48dbd1aa-44, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c9b5bdd7-dc20-4b14-a58e-109b312cc452) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:40 user nova-compute[75258]: INFO os_vif [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:d2:8b,bridge_name='br-int',has_traffic_filtering=True,id=48dbd1aa-4424-4a29-8054-5a5d8d53bf8a,network=Network(1ae924d4-0297-4fd7-95cc-883a070c666b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap48dbd1aa-44')
Nov 14 12:43:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Deleting instance files /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab_del
Nov 14 12:43:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Deletion of /opt/stack/data/nova/instances/10574d06-4168-43c2-bf6b-22a1a55febab_del complete
Nov 14 12:43:40 user nova-compute[75258]: INFO nova.compute.manager [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 12:43:40 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:43:40 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:43:41 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:43:41 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Took 0.81 seconds to deallocate network for instance.
Nov 14 12:43:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.305s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:42 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Deleted allocations for instance 10574d06-4168-43c2-bf6b-22a1a55febab
Nov 14 12:43:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-072aa0cf-366c-46fa-b91f-758b050285ae tempest-TestVolumeSwap-1946407222 tempest-TestVolumeSwap-1946407222-project-member] Lock "10574d06-4168-43c2-bf6b-22a1a55febab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.318s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-26369f68-19a5-4bef-ae50-497052d06833 req-6a7b897d-345d-43ef-9617-9f6b99d13284 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-26369f68-19a5-4bef-ae50-497052d06833 req-6a7b897d-345d-43ef-9617-9f6b99d13284 service nova] Acquiring lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-26369f68-19a5-4bef-ae50-497052d06833 req-6a7b897d-345d-43ef-9617-9f6b99d13284 service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-26369f68-19a5-4bef-ae50-497052d06833 req-6a7b897d-345d-43ef-9617-9f6b99d13284 service nova] Lock "10574d06-4168-43c2-bf6b-22a1a55febab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:43:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-26369f68-19a5-4bef-ae50-497052d06833 req-6a7b897d-345d-43ef-9617-9f6b99d13284 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] No waiting events found dispatching network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:43:42 user nova-compute[75258]: WARNING nova.compute.manager [req-26369f68-19a5-4bef-ae50-497052d06833 req-6a7b897d-345d-43ef-9617-9f6b99d13284 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received unexpected event network-vif-plugged-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a for instance with vm_state deleted and task_state None.
Nov 14 12:43:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-26369f68-19a5-4bef-ae50-497052d06833 req-6a7b897d-345d-43ef-9617-9f6b99d13284 service nova] [instance: 10574d06-4168-43c2-bf6b-22a1a55febab] Received event network-vif-deleted-48dbd1aa-4424-4a29-8054-5a5d8d53bf8a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:43:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:43:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:43:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:43:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:43:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:43:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquired lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'info_cache' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.base [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.network.neutron [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Releasing lock "refresh_cache-ac186509-f835-453a-b683-c6d3901babba" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:44:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance destroyed successfully.
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'resources' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.base [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG os_vif [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap088cce2a-36, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ddbb6b61-eab4-4990-bc63-8ea6f826346e) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:07 user nova-compute[75258]: INFO os_vif [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36')
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Start _get_guest_xml network_info=[{"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'numa_topology' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.base [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:44:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:44:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'vcpu_model' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.base [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'pci_devices' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.objects.base [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:44:07 user nova-compute[75258]:   <uuid>ac186509-f835-453a-b683-c6d3901babba</uuid>
Nov 14 12:44:07 user nova-compute[75258]:   <name>instance-00000003</name>
Nov 14 12:44:07 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:44:07 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:44:07 user nova-compute[75258]:   <metadata>
Nov 14 12:44:07 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:44:07 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:44:07 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeTestJSON-server-1628417232</nova:name>
Nov 14 12:44:07 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:44:07</nova:creationTime>
Nov 14 12:44:07 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:44:07 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:44:07 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:44:07 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:44:07 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:44:07 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:44:07 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:44:07 user nova-compute[75258]:       <nova:owner>
Nov 14 12:44:07 user nova-compute[75258]:         <nova:user uuid="807e1725870b4bca88785bd3f81aa06b">tempest-AttachVolumeTestJSON-528350005-project-member</nova:user>
Nov 14 12:44:07 user nova-compute[75258]:         <nova:project uuid="84d45cf00d6749eabfd3bc56b38a5d4a">tempest-AttachVolumeTestJSON-528350005</nova:project>
Nov 14 12:44:07 user nova-compute[75258]:       </nova:owner>
Nov 14 12:44:07 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:44:07 user nova-compute[75258]:       <nova:ports>
Nov 14 12:44:07 user nova-compute[75258]:         <nova:port uuid="088cce2a-366c-4b1e-a9cd-f9dba80599b0">
Nov 14 12:44:07 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 12:44:07 user nova-compute[75258]:         </nova:port>
Nov 14 12:44:07 user nova-compute[75258]:       </nova:ports>
Nov 14 12:44:07 user nova-compute[75258]:     </nova:instance>
Nov 14 12:44:07 user nova-compute[75258]:   </metadata>
Nov 14 12:44:07 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:44:07 user nova-compute[75258]:     <system>
Nov 14 12:44:07 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:44:07 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:44:07 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:44:07 user nova-compute[75258]:       <entry name="serial">ac186509-f835-453a-b683-c6d3901babba</entry>
Nov 14 12:44:07 user nova-compute[75258]:       <entry name="uuid">ac186509-f835-453a-b683-c6d3901babba</entry>
Nov 14 12:44:07 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:44:07 user nova-compute[75258]:     </system>
Nov 14 12:44:07 user nova-compute[75258]:   </sysinfo>
Nov 14 12:44:07 user nova-compute[75258]:   <os>
Nov 14 12:44:07 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:44:07 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:44:07 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:44:07 user nova-compute[75258]:   </os>
Nov 14 12:44:07 user nova-compute[75258]:   <features>
Nov 14 12:44:07 user nova-compute[75258]:     <acpi/>
Nov 14 12:44:07 user nova-compute[75258]:     <apic/>
Nov 14 12:44:07 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:44:07 user nova-compute[75258]:   </features>
Nov 14 12:44:07 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:44:07 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:44:07 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:44:07 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:44:07 user nova-compute[75258]:   </clock>
Nov 14 12:44:07 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:44:07 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:44:07 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:44:07 user nova-compute[75258]:   </cpu>
Nov 14 12:44:07 user nova-compute[75258]:   <devices>
Nov 14 12:44:07 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:44:07 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:44:07 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk"/>
Nov 14 12:44:07 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:44:07 user nova-compute[75258]:     </disk>
Nov 14 12:44:07 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:44:07 user nova-compute[75258]:       <mac address="fa:16:3e:5e:d1:fb"/>
Nov 14 12:44:07 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:44:07 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:44:07 user nova-compute[75258]:       <target dev="tap088cce2a-36"/>
Nov 14 12:44:07 user nova-compute[75258]:     </interface>
Nov 14 12:44:07 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:44:07 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/console.log" append="off"/>
Nov 14 12:44:07 user nova-compute[75258]:     </serial>
Nov 14 12:44:07 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:44:07 user nova-compute[75258]:     <video>
Nov 14 12:44:07 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:44:07 user nova-compute[75258]:     </video>
Nov 14 12:44:07 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:44:07 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:44:07 user nova-compute[75258]:     </rng>
Nov 14 12:44:07 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:44:07 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:44:07 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:44:07 user nova-compute[75258]:     </memballoon>
Nov 14 12:44:07 user nova-compute[75258]:   </devices>
Nov 14 12:44:07 user nova-compute[75258]: </domain>
Nov 14 12:44:07 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:44:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'trusted_certs' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.objects.base [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Cannot resize image /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'migration_context' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.objects.base [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Object Instance<ac186509-f835-453a-b683-c6d3901babba> lazy-loaded attributes: flavor,info_cache,resources,numa_topology,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:42:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG os_vif [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd1d275ba-3ffa-5676-9a4e-6918f5a8ad5c', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap088cce2a-36, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap088cce2a-36, col_values=(('qos', UUID('e52545be-4e74-4fab-b2e1-85cf4180f137')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap088cce2a-36, col_values=(('external_ids', {'iface-id': '088cce2a-366c-4b1e-a9cd-f9dba80599b0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:d1:fb', 'vm-uuid': 'ac186509-f835-453a-b683-c6d3901babba'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:44:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:08 user nova-compute[75258]: INFO os_vif [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36')
Nov 14 12:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-06b85841-634f-4c2f-8c92-ccbd9dfee313 req-c2f96465-2185-40a7-b8ed-4839cb8bbf0b service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06b85841-634f-4c2f-8c92-ccbd9dfee313 req-c2f96465-2185-40a7-b8ed-4839cb8bbf0b service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06b85841-634f-4c2f-8c92-ccbd9dfee313 req-c2f96465-2185-40a7-b8ed-4839cb8bbf0b service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06b85841-634f-4c2f-8c92-ccbd9dfee313 req-c2f96465-2185-40a7-b8ed-4839cb8bbf0b service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-06b85841-634f-4c2f-8c92-ccbd9dfee313 req-c2f96465-2185-40a7-b8ed-4839cb8bbf0b service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:44:10 user nova-compute[75258]: WARNING nova.compute.manager [req-06b85841-634f-4c2f-8c92-ccbd9dfee313 req-c2f96465-2185-40a7-b8ed-4839cb8bbf0b service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state stopped and task_state powering-on.
Nov 14 12:44:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:44:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance rebooted successfully.
Nov 14 12:44:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e780f01a-8b2e-44d8-8d60-fd431b37b8eb tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:44:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-6c4dfdd9-2455-415b-8eaf-6cbc2ba5fe36 req-d17998a9-7745-4bd1-a574-7be355021f5a service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:44:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6c4dfdd9-2455-415b-8eaf-6cbc2ba5fe36 req-d17998a9-7745-4bd1-a574-7be355021f5a service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6c4dfdd9-2455-415b-8eaf-6cbc2ba5fe36 req-d17998a9-7745-4bd1-a574-7be355021f5a service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6c4dfdd9-2455-415b-8eaf-6cbc2ba5fe36 req-d17998a9-7745-4bd1-a574-7be355021f5a service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-6c4dfdd9-2455-415b-8eaf-6cbc2ba5fe36 req-d17998a9-7745-4bd1-a574-7be355021f5a service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:44:12 user nova-compute[75258]: WARNING nova.compute.manager [req-6c4dfdd9-2455-415b-8eaf-6cbc2ba5fe36 req-d17998a9-7745-4bd1-a574-7be355021f5a service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state active and task_state None.
Nov 14 12:44:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:44:16 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8570MB free_disk=25.332260131835938GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.364s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:44:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:44:43 user nova-compute[75258]: INFO nova.compute.claims [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Claim successful on node user
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:44:43 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.policy [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cef85161135e4a978dd763ae91809be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c593ba588c7f442689362cda037f95f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:44:43 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Creating image(s)
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "/opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk 1073741824" returned: 0 in 0.056s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Successfully created port: ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Checking if we can resize image /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Cannot resize image /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Ensure instance console log exists: /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Successfully updated port: ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-changed-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:44:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Refreshing instance network info cache due to event network-changed-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] Acquiring lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Updating instance_info_cache with network_info: [{"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Instance network_info: |[{"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] Acquired lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.neutron [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Refreshing network info cache for port ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Start _get_guest_xml network_info=[{"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:44:45 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:44:45 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1647071446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1647071446',id=22,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-p0i1i32o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:44:44Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=9ddad9fb-2478-4c56-8522-afdc3b2b2632,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:73:b9,bridge_name='br-int',has_traffic_filtering=True,id=ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf2a47a-8c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'pci_devices' on Instance uuid 9ddad9fb-2478-4c56-8522-afdc3b2b2632 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:44:45 user nova-compute[75258]:   <uuid>9ddad9fb-2478-4c56-8522-afdc3b2b2632</uuid>
Nov 14 12:44:45 user nova-compute[75258]:   <name>instance-00000016</name>
Nov 14 12:44:45 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:44:45 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:44:45 user nova-compute[75258]:   <metadata>
Nov 14 12:44:45 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:44:45 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:44:45 user nova-compute[75258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1647071446</nova:name>
Nov 14 12:44:45 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:44:45</nova:creationTime>
Nov 14 12:44:45 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:44:45 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:44:45 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:44:45 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:44:45 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:44:45 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:44:45 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:44:45 user nova-compute[75258]:       <nova:owner>
Nov 14 12:44:45 user nova-compute[75258]:         <nova:user uuid="cef85161135e4a978dd763ae91809be9">tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member</nova:user>
Nov 14 12:44:45 user nova-compute[75258]:         <nova:project uuid="c593ba588c7f442689362cda037f95f8">tempest-ServerBootFromVolumeStableRescueTest-1735756414</nova:project>
Nov 14 12:44:45 user nova-compute[75258]:       </nova:owner>
Nov 14 12:44:45 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:44:45 user nova-compute[75258]:       <nova:ports>
Nov 14 12:44:45 user nova-compute[75258]:         <nova:port uuid="ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c">
Nov 14 12:44:45 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 12:44:45 user nova-compute[75258]:         </nova:port>
Nov 14 12:44:45 user nova-compute[75258]:       </nova:ports>
Nov 14 12:44:45 user nova-compute[75258]:     </nova:instance>
Nov 14 12:44:45 user nova-compute[75258]:   </metadata>
Nov 14 12:44:45 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:44:45 user nova-compute[75258]:     <system>
Nov 14 12:44:45 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:44:45 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:44:45 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:44:45 user nova-compute[75258]:       <entry name="serial">9ddad9fb-2478-4c56-8522-afdc3b2b2632</entry>
Nov 14 12:44:45 user nova-compute[75258]:       <entry name="uuid">9ddad9fb-2478-4c56-8522-afdc3b2b2632</entry>
Nov 14 12:44:45 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:44:45 user nova-compute[75258]:     </system>
Nov 14 12:44:45 user nova-compute[75258]:   </sysinfo>
Nov 14 12:44:45 user nova-compute[75258]:   <os>
Nov 14 12:44:45 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:44:45 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:44:45 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:44:45 user nova-compute[75258]:   </os>
Nov 14 12:44:45 user nova-compute[75258]:   <features>
Nov 14 12:44:45 user nova-compute[75258]:     <acpi/>
Nov 14 12:44:45 user nova-compute[75258]:     <apic/>
Nov 14 12:44:45 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:44:45 user nova-compute[75258]:   </features>
Nov 14 12:44:45 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:44:45 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:44:45 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:44:45 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:44:45 user nova-compute[75258]:   </clock>
Nov 14 12:44:45 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:44:45 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:44:45 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:44:45 user nova-compute[75258]:   </cpu>
Nov 14 12:44:45 user nova-compute[75258]:   <devices>
Nov 14 12:44:45 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:44:45 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:44:45 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk"/>
Nov 14 12:44:45 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:44:45 user nova-compute[75258]:     </disk>
Nov 14 12:44:45 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:44:45 user nova-compute[75258]:       <mac address="fa:16:3e:08:73:b9"/>
Nov 14 12:44:45 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:44:45 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:44:45 user nova-compute[75258]:       <target dev="tapecf2a47a-8c"/>
Nov 14 12:44:45 user nova-compute[75258]:     </interface>
Nov 14 12:44:45 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:44:45 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/console.log" append="off"/>
Nov 14 12:44:45 user nova-compute[75258]:     </serial>
Nov 14 12:44:45 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:44:45 user nova-compute[75258]:     <video>
Nov 14 12:44:45 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:44:45 user nova-compute[75258]:     </video>
Nov 14 12:44:45 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:44:45 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:44:45 user nova-compute[75258]:     </rng>
Nov 14 12:44:45 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:44:45 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:44:45 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:44:45 user nova-compute[75258]:     </memballoon>
Nov 14 12:44:45 user nova-compute[75258]:   </devices>
Nov 14 12:44:45 user nova-compute[75258]: </domain>
Nov 14 12:44:45 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1647071446',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1647071446',id=22,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-p0i1i32o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:44:44Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=9ddad9fb-2478-4c56-8522-afdc3b2b2632,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:08:73:b9,bridge_name='br-int',has_traffic_filtering=True,id=ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf2a47a-8c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG os_vif [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:73:b9,bridge_name='br-int',has_traffic_filtering=True,id=ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf2a47a-8c') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '89cd2870-1c22-5271-af02-8cbc81135291', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapecf2a47a-8c, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapecf2a47a-8c, col_values=(('qos', UUID('c8f6f33f-c2d1-4a62-815e-5bb9fed26cc2')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapecf2a47a-8c, col_values=(('external_ids', {'iface-id': 'ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:08:73:b9', 'vm-uuid': '9ddad9fb-2478-4c56-8522-afdc3b2b2632'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:45 user nova-compute[75258]: INFO os_vif [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:08:73:b9,bridge_name='br-int',has_traffic_filtering=True,id=ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf2a47a-8c')
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No VIF found with MAC fa:16:3e:08:73:b9, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.neutron [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Updated VIF entry in instance network info cache for port ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG nova.network.neutron [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Updating instance_info_cache with network_info: [{"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:44:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e59a7e32-3664-45fc-9538-11aa939bf049 req-911f8fc7-71a1-4213-bf39-c407c2c36a3b service nova] Releasing lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:44:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-dd5e8d6c-2877-4e77-b2a7-423052beea5d req-b3774598-bd32-48c0-b1fa-5bc4d11639d4 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:44:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dd5e8d6c-2877-4e77-b2a7-423052beea5d req-b3774598-bd32-48c0-b1fa-5bc4d11639d4 service nova] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dd5e8d6c-2877-4e77-b2a7-423052beea5d req-b3774598-bd32-48c0-b1fa-5bc4d11639d4 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dd5e8d6c-2877-4e77-b2a7-423052beea5d req-b3774598-bd32-48c0-b1fa-5bc4d11639d4 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-dd5e8d6c-2877-4e77-b2a7-423052beea5d req-b3774598-bd32-48c0-b1fa-5bc4d11639d4 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] No waiting events found dispatching network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:44:46 user nova-compute[75258]: WARNING nova.compute.manager [req-dd5e8d6c-2877-4e77-b2a7-423052beea5d req-b3774598-bd32-48c0-b1fa-5bc4d11639d4 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received unexpected event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c for instance with vm_state building and task_state spawning.
Nov 14 12:44:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:44:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Instance spawned successfully.
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:44:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:44:49 user nova-compute[75258]: INFO nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Took 5.35 seconds to spawn the instance on the hypervisor.
Nov 14 12:44:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:44:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-6e8e95fa-4470-45cd-9e7d-2e0f4f70fb81 req-b3451ac8-a8db-4058-8bcc-66d1a5345075 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:44:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6e8e95fa-4470-45cd-9e7d-2e0f4f70fb81 req-b3451ac8-a8db-4058-8bcc-66d1a5345075 service nova] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6e8e95fa-4470-45cd-9e7d-2e0f4f70fb81 req-b3451ac8-a8db-4058-8bcc-66d1a5345075 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6e8e95fa-4470-45cd-9e7d-2e0f4f70fb81 req-b3451ac8-a8db-4058-8bcc-66d1a5345075 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-6e8e95fa-4470-45cd-9e7d-2e0f4f70fb81 req-b3451ac8-a8db-4058-8bcc-66d1a5345075 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] No waiting events found dispatching network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:44:49 user nova-compute[75258]: WARNING nova.compute.manager [req-6e8e95fa-4470-45cd-9e7d-2e0f4f70fb81 req-b3451ac8-a8db-4058-8bcc-66d1a5345075 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received unexpected event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c for instance with vm_state building and task_state spawning.
Nov 14 12:44:49 user nova-compute[75258]: INFO nova.compute.manager [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Took 6.13 seconds to build instance.
Nov 14 12:44:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6b7bcb4d-9f63-4b51-b6a3-49fb1024e44d tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.222s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG nova.objects.instance [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lazy-loading 'flavor' on Instance uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.076s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:50 user nova-compute[75258]: INFO nova.compute.manager [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Attaching volume 6120e31a-3661-4d2d-a8cf-34fbd55386c8 to /dev/vdb
Nov 14 12:44:50 user nova-compute[75258]: DEBUG os_brick.utils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e81d4780-10d9-4b00-b8f8-47ea0428d5b2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dec0099d-082f-483e-9a5d-06f7c89f751f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[30369300-bd42-4918-b614-a7e6aa0bcf89]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed682b30-bd15-4746-8faf-d17d2cdd44d6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:44:51 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:44:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63f1f6a4-df13-4903-9eae-92253c062f32]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG os_brick.utils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:44:51 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating existing volume attachment record: 84121551-2a49-4012-8fa7-cdfa487b85c4 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:44:55 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:44:55 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:44:55 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[614b5580-c793-49dc-9553-521f0bfeb872]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:44:55 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff8c98fd-6b14-43b6-b027-16a11b077fc3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8] added
Nov 14 12:44:55 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9935069-be02-46c4-a1b3-a2acbab23fbd]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:44:55 user nova-compute[75258]: INFO nova.compute.claims [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Claim successful on node user
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3b202e-4a5a-4165-ad40-6b938e4d7fba]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxgHMlwq {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxgHMlwq" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d0ac41-aba8-446b-8355-8c3be3d7a967]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxgHMlwq'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[836928e5-6a01-4da2-8184-f9beb77d9b5f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4279a562-842a-43d6-b92f-c0879d213a62]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7991b113-1846-4b82-8dd3-c49d888b7b1b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]
Nov 14 12:44:56 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.
Nov 14 12:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd352aaa-439c-442e-9e17-8be81f9433a4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dac6800-3b97-444c-bd41-36a2709df2e8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:44:56 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:44:56 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] HCTL ('33', '-', '-', 0) found on session 30 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[390a5ce9-49e0-44d2-93b4-16be307a12c2]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching for a device in session 30 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.429s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.network.neutron [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:44:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:44:56 user nova-compute[75258]: INFO nova.virt.block_device [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Booting with volume dce3d526-3833-4dde-ab66-ffe18b83de13 at /dev/vda
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.policy [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5ab782add99f4231b2d7bbfd078edf62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6554d9e28ce942b5933421198c41ff9a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.utils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1deb827-b57b-4e83-aca4-54e3b46ddb88]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4381a2a-e130-467e-90ea-865c78adddad]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[877957c1-e493-407c-a830-cca39be1084c]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6e138eb-f66c-434a-a570-0ae79b83c3a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:44:56 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada66c6d-70cc-40c0-9ea1-abe92c2b1b17]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG os_brick.utils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:44:56 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updating existing volume attachment record: 603ed338-c0be-4f5b-b9c9-25a068cb3c69 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== connect_volume: return (1336ms) {'type': 'block', 'scsi_wwn': '26163643339343635', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163643339343635', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG nova.objects.instance [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lazy-loading 'flavor' on Instance uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:44:57 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:44:57 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:44:57 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:44:57 user nova-compute[75258]:   <serial>6120e31a-3661-4d2d-a8cf-34fbd55386c8</serial>
Nov 14 12:44:57 user nova-compute[75258]: </disk>
Nov 14 12:44:57 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG nova.network.neutron [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Successfully created port: 7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No VIF found with MAC fa:16:3e:42:82:58, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79203734-f41f-40c4-9d69-f91c97955b42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.933s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.network.neutron [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Successfully updated port: 7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquired lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.network.neutron [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-changed-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Refreshing instance network info cache due to event network-changed-7226e7fb-4e03-4182-a445-a30648b37027. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] Acquiring lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.network.neutron [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.network.neutron [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updating instance_info_cache with network_info: [{"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Releasing lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance network_info: |[{"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] Acquired lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:44:58 user nova-compute[75258]: DEBUG nova.network.neutron [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Refreshing network info cache for port 7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:44:59 user nova-compute[75258]: DEBUG nova.network.neutron [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updated VIF entry in instance network info cache for port 7226e7fb-4e03-4182-a445-a30648b37027. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:44:59 user nova-compute[75258]: DEBUG nova.network.neutron [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updating instance_info_cache with network_info: [{"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:44:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c1b6ab5d-7cbd-4608-927d-eaef4dda98ec req-e2424218-1efe-40b3-b0b4-5f602cd457d7 service nova] Releasing lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:44:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG nova.compute.manager [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Stashing vm_state: active {{(pid=75258) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:45:00 user nova-compute[75258]: INFO nova.compute.claims [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Claim successful on node user
Nov 14 12:45:00 user nova-compute[75258]: INFO nova.compute.resource_tracker [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating resource usage from migration f432c86b-10e8-4911-bf2c-4f5373296505
Nov 14 12:45:00 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.357s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:00 user nova-compute[75258]: INFO nova.compute.manager [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Migrating
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquired lock "compute-rpcapi-router" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:45:00 user nova-compute[75258]: INFO nova.compute.rpcapi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Releasing lock "compute-rpcapi-router" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:45:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.network.neutron [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:45:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Creating image(s)
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Ensure instance console log exists: /opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Start _get_guest_xml network_info=[{"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f91e625f-a68e-4da4-aeb8-067f96d649a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'dce3d526-3833-4dde-ab66-ffe18b83de13', 'serial': 'dce3d526-3833-4dde-ab66-ffe18b83de13'}, 'device_type': 'disk', 'attachment_id': '603ed338-c0be-4f5b-b9c9-25a068cb3c69', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:45:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:45:01 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:45:01 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:45:01 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fefafdd-3a89-4746-8097-1d77bb4fa0b7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:45:01 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Starting migrate_disk_and_power_off {{(pid=75258) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7b635a4-1aeb-4149-b29f-ae53c7f6f5b6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13] added
Nov 14 12:45:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b67d5fd-a9c2-4100-bc2a-a255c465c06a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[adeb7612-013c-4c76-b09f-4a146c580447]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUzKAPuo {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUzKAPuo" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bdc324c-8f72-48a7-96bb-7bdacee19a61]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bUzKAPuo'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4fa5e89-8dc6-4a3f-bb16-13eddc2fd2db]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c56c4d2-96b0-4ef6-bdae-003c11287b2e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2028b3ee-2800-4b50-aea5-da227491ad06]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]
Nov 14 12:45:01 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.
Nov 14 12:45:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c437dce-dd11-4cf3-9494-6de397dfed38]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb66316-85d5-4cae-87e9-f1d1ff05f755]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:01 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] HCTL ('35', '-', '-', 0) found on session 31 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-ab889aae-8898-44be-aae5-628cafbfc73b req-a873a112-6325-484d-b0a8-c66ae03ed7fc service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab889aae-8898-44be-aae5-628cafbfc73b req-a873a112-6325-484d-b0a8-c66ae03ed7fc service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab889aae-8898-44be-aae5-628cafbfc73b req-a873a112-6325-484d-b0a8-c66ae03ed7fc service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab889aae-8898-44be-aae5-628cafbfc73b req-a873a112-6325-484d-b0a8-c66ae03ed7fc service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-ab889aae-8898-44be-aae5-628cafbfc73b req-a873a112-6325-484d-b0a8-c66ae03ed7fc service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:01 user nova-compute[75258]: WARNING nova.compute.manager [req-ab889aae-8898-44be-aae5-628cafbfc73b req-a873a112-6325-484d-b0a8-c66ae03ed7fc service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state active and task_state resize_migrating.
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f0c13af-b7f5-4e58-8e7a-d427cfc3ba00]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Searching for a device in session 31 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:45:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:45:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance destroyed successfully.
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:45:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1917800253-network", "vif_mac": "fa:16:3e:42:82:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1917800253-network", "vif_mac": "fa:16:3e:42:82:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_vif [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fe5608-d5, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9404c481-55c8-4b9b-95b3-bcb02e4f306e) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:02 user nova-compute[75258]: INFO os_vif [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5')
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:45:02 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] <== connect_volume: return (1364ms) {'type': 'block', 'scsi_wwn': '23864303466343138', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864303466343138', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.479s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7b8cb3c-6862-4f99-aaf5-516ed1a9b3b7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:45:02 user nova-compute[75258]: No targets found.
Nov 14 12:45:02 user nova-compute[75258]: iSNS:
Nov 14 12:45:02 user nova-compute[75258]: No targets found.
Nov 14 12:45:02 user nova-compute[75258]: STATIC:
Nov 14 12:45:02 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:45:02 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:45:02 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:45:02 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13
Nov 14 12:45:02 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:45:02 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:45:02 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:45:02 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:45:02 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:45:02 user nova-compute[75258]: FIRMWARE:
Nov 14 12:45:02 user nova-compute[75258]: No targets found.
Nov 14 12:45:02 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:45:02 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:45:02 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1871672058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1871672058',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ4EpalNHCuF/5YOtbe9vY1rDMtV3ANQJGWd7bNGBYdS3J6OMVDpSn+QMjc5MdIMPIZVzscHiy5W+ETizBVxNGIKcEQFM+4lsGLUuCbAPdQKTUdKxiCItircAwA8jYSwA==',key_name='tempest-keypair-872410949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6554d9e28ce942b5933421198c41ff9a',ramdisk_id='',reservation_id='r-2p0el8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1507651178',owner_user_name='tempest-ServerActionsV293TestJSON-1507651178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ab782add99f4231b2d7bbfd078edf62',uuid=f91e625f-a68e-4da4-aeb8-067f96d649a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converting VIF {"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lazy-loading 'pci_devices' on Instance uuid f91e625f-a68e-4da4-aeb8-067f96d649a2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:45:02 user nova-compute[75258]:   <uuid>f91e625f-a68e-4da4-aeb8-067f96d649a2</uuid>
Nov 14 12:45:02 user nova-compute[75258]:   <name>instance-00000017</name>
Nov 14 12:45:02 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:45:02 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:45:02 user nova-compute[75258]:   <metadata>
Nov 14 12:45:02 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:45:02 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:45:02 user nova-compute[75258]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1871672058</nova:name>
Nov 14 12:45:02 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:45:01</nova:creationTime>
Nov 14 12:45:02 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:45:02 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:45:02 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:45:02 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:45:02 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:45:02 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:45:02 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:45:02 user nova-compute[75258]:       <nova:owner>
Nov 14 12:45:02 user nova-compute[75258]:         <nova:user uuid="5ab782add99f4231b2d7bbfd078edf62">tempest-ServerActionsV293TestJSON-1507651178-project-member</nova:user>
Nov 14 12:45:02 user nova-compute[75258]:         <nova:project uuid="6554d9e28ce942b5933421198c41ff9a">tempest-ServerActionsV293TestJSON-1507651178</nova:project>
Nov 14 12:45:02 user nova-compute[75258]:       </nova:owner>
Nov 14 12:45:02 user nova-compute[75258]:       <nova:ports>
Nov 14 12:45:02 user nova-compute[75258]:         <nova:port uuid="7226e7fb-4e03-4182-a445-a30648b37027">
Nov 14 12:45:02 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 12:45:02 user nova-compute[75258]:         </nova:port>
Nov 14 12:45:02 user nova-compute[75258]:       </nova:ports>
Nov 14 12:45:02 user nova-compute[75258]:     </nova:instance>
Nov 14 12:45:02 user nova-compute[75258]:   </metadata>
Nov 14 12:45:02 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:45:02 user nova-compute[75258]:     <system>
Nov 14 12:45:02 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:45:02 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:45:02 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:45:02 user nova-compute[75258]:       <entry name="serial">f91e625f-a68e-4da4-aeb8-067f96d649a2</entry>
Nov 14 12:45:02 user nova-compute[75258]:       <entry name="uuid">f91e625f-a68e-4da4-aeb8-067f96d649a2</entry>
Nov 14 12:45:02 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:45:02 user nova-compute[75258]:     </system>
Nov 14 12:45:02 user nova-compute[75258]:   </sysinfo>
Nov 14 12:45:02 user nova-compute[75258]:   <os>
Nov 14 12:45:02 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:45:02 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:45:02 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:45:02 user nova-compute[75258]:   </os>
Nov 14 12:45:02 user nova-compute[75258]:   <features>
Nov 14 12:45:02 user nova-compute[75258]:     <acpi/>
Nov 14 12:45:02 user nova-compute[75258]:     <apic/>
Nov 14 12:45:02 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:45:02 user nova-compute[75258]:   </features>
Nov 14 12:45:02 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:45:02 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:45:02 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:45:02 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:45:02 user nova-compute[75258]:   </clock>
Nov 14 12:45:02 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:45:02 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:45:02 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:45:02 user nova-compute[75258]:   </cpu>
Nov 14 12:45:02 user nova-compute[75258]:   <devices>
Nov 14 12:45:02 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:45:02 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:45:02 user nova-compute[75258]:       <source dev="/dev/sdd"/>
Nov 14 12:45:02 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:45:02 user nova-compute[75258]:       <serial>dce3d526-3833-4dde-ab66-ffe18b83de13</serial>
Nov 14 12:45:02 user nova-compute[75258]:     </disk>
Nov 14 12:45:02 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:45:02 user nova-compute[75258]:       <mac address="fa:16:3e:e5:aa:15"/>
Nov 14 12:45:02 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:45:02 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:45:02 user nova-compute[75258]:       <target dev="tap7226e7fb-4e"/>
Nov 14 12:45:02 user nova-compute[75258]:     </interface>
Nov 14 12:45:02 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:45:02 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2/console.log" append="off"/>
Nov 14 12:45:02 user nova-compute[75258]:     </serial>
Nov 14 12:45:02 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:45:02 user nova-compute[75258]:     <video>
Nov 14 12:45:02 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:45:02 user nova-compute[75258]:     </video>
Nov 14 12:45:02 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:45:02 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:45:02 user nova-compute[75258]:     </rng>
Nov 14 12:45:02 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:45:02 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:45:02 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:45:02 user nova-compute[75258]:     </memballoon>
Nov 14 12:45:02 user nova-compute[75258]:   </devices>
Nov 14 12:45:02 user nova-compute[75258]: </domain>
Nov 14 12:45:02 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1871672058',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1871672058',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ4EpalNHCuF/5YOtbe9vY1rDMtV3ANQJGWd7bNGBYdS3J6OMVDpSn+QMjc5MdIMPIZVzscHiy5W+ETizBVxNGIKcEQFM+4lsGLUuCbAPdQKTUdKxiCItircAwA8jYSwA==',key_name='tempest-keypair-872410949',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='6554d9e28ce942b5933421198c41ff9a',ramdisk_id='',reservation_id='r-2p0el8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1507651178',owner_user_name='tempest-ServerActionsV293TestJSON-1507651178-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:44:56Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ab782add99f4231b2d7bbfd078edf62',uuid=f91e625f-a68e-4da4-aeb8-067f96d649a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converting VIF {"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG os_vif [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d1884e-69d7-42cb-b52e-eb6f278170e2]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb092288-97f6-5122-b675-6d06d894ad47', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7226e7fb-4e, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7226e7fb-4e, col_values=(('qos', UUID('792c6aec-238a-4a59-af5f-b37abc315c28')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7226e7fb-4e, col_values=(('external_ids', {'iface-id': '7226e7fb-4e03-4182-a445-a30648b37027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:aa:15', 'vm-uuid': 'f91e625f-a68e-4da4-aeb8-067f96d649a2'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:03 user nova-compute[75258]: INFO os_vif [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e')
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89357a2-8cec-4422-8c82-0fb5268f0992]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:03 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:03 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:03 user nova-compute[75258]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:03 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b4080550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9460f1a1-802e-4db6-9a76-4edb1132823f]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8b11bee-c09f-49bd-9a24-674300dfe341]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] No VIF found with MAC fa:16:3e:e5:aa:15, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b88435d-c281-4477-b228-64d3aae842fb]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f2a0c7-a7fc-4fcd-b34d-7de3901bee01]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[29082b6b-2f79-4bda-b534-ccd97cd1bb75]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed59ceb6-1158-47bd-b64e-292ef6d2ce4a]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]
Nov 14 12:45:03 user nova-compute[75258]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.
Nov 14 12:45:03 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1f77a3-6772-4716-b002-0fb310d41987]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== disconnect_volume: return (789ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb_resize/disk /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "cp -r /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb_resize/disk /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk" returned: 0 in 0.325s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb_resize/disk.info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk.info {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-06dc077a-5e45-4499-88f9-612d36b96123 req-06ffeb1f-5616-433a-818c-2451f29ee43e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06dc077a-5e45-4499-88f9-612d36b96123 req-06ffeb1f-5616-433a-818c-2451f29ee43e service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06dc077a-5e45-4499-88f9-612d36b96123 req-06ffeb1f-5616-433a-818c-2451f29ee43e service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06dc077a-5e45-4499-88f9-612d36b96123 req-06ffeb1f-5616-433a-818c-2451f29ee43e service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-06dc077a-5e45-4499-88f9-612d36b96123 req-06ffeb1f-5616-433a-818c-2451f29ee43e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:03 user nova-compute[75258]: WARNING nova.compute.manager [req-06dc077a-5e45-4499-88f9-612d36b96123 req-06ffeb1f-5616-433a-818c-2451f29ee43e service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state active and task_state resize_migrating.
Nov 14 12:45:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "cp -r /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb_resize/disk.info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk.info" returned: 0 in 0.048s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Port f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 binding to destination host user is already ACTIVE {{(pid=75258) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-changed-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Refreshing instance network info cache due to event network-changed-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] Acquiring lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] Acquired lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.network.neutron [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Refreshing network info cache for port 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.network.neutron [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updated VIF entry in instance network info cache for port 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.network.neutron [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f465cd-83e5-4381-b746-470278c4b11e req-548bc5b0-c526-41e1-99dd-55fb70ae1405 service nova] Releasing lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG os_brick.utils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[86804ab0-ece2-473c-9f82-47b3fdb9d10d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c705be82-7af1-479d-bd38-8edfaa11ccf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb612ba-45ff-4fff-83a9-3f16bc05c222]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecf2ffec-9517-4cbe-8495-eb136c38eca0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:45:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:45:06 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa14e4ed-e574-47bd-aefb-edcca22f8c25]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG os_brick.utils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No waiting events found dispatching network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:06 user nova-compute[75258]: WARNING nova.compute.manager [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received unexpected event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with vm_state building and task_state spawning.
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No waiting events found dispatching network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:06 user nova-compute[75258]: WARNING nova.compute.manager [req-3c4ace65-3d73-4fb3-a2d8-678cd2f7fdaf req-b3ba77c8-2109-41fa-a344-741251506488 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received unexpected event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with vm_state building and task_state spawning.
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:45:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance spawned successfully.
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:06 user nova-compute[75258]: INFO nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Took 5.20 seconds to spawn the instance on the hypervisor.
Nov 14 12:45:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:45:06 user nova-compute[75258]: INFO nova.compute.manager [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Took 10.85 seconds to build instance.
Nov 14 12:45:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-984aad86-8c68-47f8-9361-a05a3c74d89c tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.978s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:45:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Starting finish_migration {{(pid=75258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 12:45:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 12:45:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Creating image(s)
Nov 14 12:45:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:10 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Checking if we can resize image /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk. size=21474836480 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:45:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk 21474836480 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk 21474836480" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Ensure instance console log exists: /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Start _get_guest_xml network_info=[{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1917800253-network", "vif_mac": "fa:16:3e:42:82:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '675b780c-92f9-41de-9457-ae035af15eeb', 'attached_at': '2023-11-14T12:45:11.000000', 'detached_at': '', 'volume_id': '6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'serial': '6120e31a-3661-4d2d-a8cf-34fbd55386c8'}, 'device_type': 'disk', 'attachment_id': '546239de-cc69-49a5-9d8e-8d3dcfaea392', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:45:11 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:11 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:45:11 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:45:11 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:45:11 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef75952-3642-4d8e-9b9d-72e655fcc858]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:45:11 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b6a437-e380-4cf7-905d-a2d708d50e2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8] added
Nov 14 12:45:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58b03930-59bb-4415-88a8-726522ad0dad]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10d0c50-d346-480a-b8c8-232b34ac7d8e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxgHMlwq {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxgHMlwq" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b30426-6f85-4082-ad7d-5fc817953033]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxgHMlwq'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[949932d7-73a4-45ec-b73d-dd7863f8d7ce]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43313f11-b7c1-4113-abe0-3aefb667c121]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c5da2d4-ebf9-4d3d-854c-c042e5e0e96b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]
Nov 14 12:45:11 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.
Nov 14 12:45:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[97112446-22cc-422c-b150-785f3e0e7e4c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a658ba2d-53c8-4f52-a1b7-d54ee94fca55]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:45:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4443c7d-10a3-46b8-964f-bcc94fc49f47]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:45:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26163643339343635', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163643339343635', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1917800253-network", "vif_mac": "fa:16:3e:42:82:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1917800253-network", "vif_mac": "fa:16:3e:42:82:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:45:12 user nova-compute[75258]:   <uuid>675b780c-92f9-41de-9457-ae035af15eeb</uuid>
Nov 14 12:45:12 user nova-compute[75258]:   <name>instance-00000013</name>
Nov 14 12:45:12 user nova-compute[75258]:   <memory>2097152</memory>
Nov 14 12:45:12 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:45:12 user nova-compute[75258]:   <metadata>
Nov 14 12:45:12 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:45:12 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:45:12 user nova-compute[75258]:       <nova:name>tempest-ServerActionsTestOtherB-server-112003904</nova:name>
Nov 14 12:45:12 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:45:11</nova:creationTime>
Nov 14 12:45:12 user nova-compute[75258]:       <nova:flavor name="m1.small">
Nov 14 12:45:12 user nova-compute[75258]:         <nova:memory>2048</nova:memory>
Nov 14 12:45:12 user nova-compute[75258]:         <nova:disk>20</nova:disk>
Nov 14 12:45:12 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:45:12 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:45:12 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:45:12 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:45:12 user nova-compute[75258]:       <nova:owner>
Nov 14 12:45:12 user nova-compute[75258]:         <nova:user uuid="873cb2d85dba423c89f8a4fd99377a14">tempest-ServerActionsTestOtherB-1658255901-project-member</nova:user>
Nov 14 12:45:12 user nova-compute[75258]:         <nova:project uuid="e3597e92033a4fedafa79d98540cc451">tempest-ServerActionsTestOtherB-1658255901</nova:project>
Nov 14 12:45:12 user nova-compute[75258]:       </nova:owner>
Nov 14 12:45:12 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:45:12 user nova-compute[75258]:       <nova:ports>
Nov 14 12:45:12 user nova-compute[75258]:         <nova:port uuid="f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40">
Nov 14 12:45:12 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 12:45:12 user nova-compute[75258]:         </nova:port>
Nov 14 12:45:12 user nova-compute[75258]:       </nova:ports>
Nov 14 12:45:12 user nova-compute[75258]:     </nova:instance>
Nov 14 12:45:12 user nova-compute[75258]:   </metadata>
Nov 14 12:45:12 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:45:12 user nova-compute[75258]:     <system>
Nov 14 12:45:12 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:45:12 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:45:12 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:45:12 user nova-compute[75258]:       <entry name="serial">675b780c-92f9-41de-9457-ae035af15eeb</entry>
Nov 14 12:45:12 user nova-compute[75258]:       <entry name="uuid">675b780c-92f9-41de-9457-ae035af15eeb</entry>
Nov 14 12:45:12 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:45:12 user nova-compute[75258]:     </system>
Nov 14 12:45:12 user nova-compute[75258]:   </sysinfo>
Nov 14 12:45:12 user nova-compute[75258]:   <os>
Nov 14 12:45:12 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:45:12 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:45:12 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:45:12 user nova-compute[75258]:   </os>
Nov 14 12:45:12 user nova-compute[75258]:   <features>
Nov 14 12:45:12 user nova-compute[75258]:     <acpi/>
Nov 14 12:45:12 user nova-compute[75258]:     <apic/>
Nov 14 12:45:12 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:45:12 user nova-compute[75258]:   </features>
Nov 14 12:45:12 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:45:12 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:45:12 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:45:12 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:45:12 user nova-compute[75258]:   </clock>
Nov 14 12:45:12 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:45:12 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:45:12 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:45:12 user nova-compute[75258]:   </cpu>
Nov 14 12:45:12 user nova-compute[75258]:   <devices>
Nov 14 12:45:12 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:45:12 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:45:12 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk"/>
Nov 14 12:45:12 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:45:12 user nova-compute[75258]:     </disk>
Nov 14 12:45:12 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:45:12 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:45:12 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 12:45:12 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:45:12 user nova-compute[75258]:       <serial>6120e31a-3661-4d2d-a8cf-34fbd55386c8</serial>
Nov 14 12:45:12 user nova-compute[75258]:     </disk>
Nov 14 12:45:12 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:45:12 user nova-compute[75258]:       <mac address="fa:16:3e:42:82:58"/>
Nov 14 12:45:12 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:45:12 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:45:12 user nova-compute[75258]:       <target dev="tapf9fe5608-d5"/>
Nov 14 12:45:12 user nova-compute[75258]:     </interface>
Nov 14 12:45:12 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:45:12 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/console.log" append="off"/>
Nov 14 12:45:12 user nova-compute[75258]:     </serial>
Nov 14 12:45:12 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:45:12 user nova-compute[75258]:     <video>
Nov 14 12:45:12 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:45:12 user nova-compute[75258]:     </video>
Nov 14 12:45:12 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:45:12 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:45:12 user nova-compute[75258]:     </rng>
Nov 14 12:45:12 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:45:12 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:45:12 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:45:12 user nova-compute[75258]:     </memballoon>
Nov 14 12:45:12 user nova-compute[75258]:   </devices>
Nov 14 12:45:12 user nova-compute[75258]: </domain>
Nov 14 12:45:12 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:45:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1917800253-network", "vif_mac": "fa:16:3e:42:82:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1917800253-network", "vif_mac": "fa:16:3e:42:82:58"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG os_vif [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5093c991-1bb6-58ee-b068-3f8e246cbdf1', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fe5608-d5, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9fe5608-d5, col_values=(('qos', UUID('4f2a2e63-448a-4c94-bba5-e1e9733b3b99')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9fe5608-d5, col_values=(('external_ids', {'iface-id': 'f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:82:58', 'vm-uuid': '675b780c-92f9-41de-9457-ae035af15eeb'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:12 user nova-compute[75258]: INFO os_vif [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5')
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:45:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] No VIF found with MAC fa:16:3e:42:82:58, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:45:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:13 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-73f6bbeb-6852-4041-aa81-e79c9617cc08 req-25f2a0f8-6947-40d2-a46e-fa861f5277c6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73f6bbeb-6852-4041-aa81-e79c9617cc08 req-25f2a0f8-6947-40d2-a46e-fa861f5277c6 service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73f6bbeb-6852-4041-aa81-e79c9617cc08 req-25f2a0f8-6947-40d2-a46e-fa861f5277c6 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-73f6bbeb-6852-4041-aa81-e79c9617cc08 req-25f2a0f8-6947-40d2-a46e-fa861f5277c6 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-73f6bbeb-6852-4041-aa81-e79c9617cc08 req-25f2a0f8-6947-40d2-a46e-fa861f5277c6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:14 user nova-compute[75258]: WARNING nova.compute.manager [req-73f6bbeb-6852-4041-aa81-e79c9617cc08 req-25f2a0f8-6947-40d2-a46e-fa861f5277c6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state active and task_state resize_finish.
Nov 14 12:45:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:45:16 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance running successfully.
Nov 14 12:45:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Failed to set time: agent not configured {{(pid=75258) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-1213b13c-e337-4f73-8af8-9a9592032c1d tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] finish_migration finished successfully. {{(pid=75258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-099d8172-ff7c-4387-82d8-e35a4095b287 req-c361edb4-a581-4f7a-a510-7655c884b6ae service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-099d8172-ff7c-4387-82d8-e35a4095b287 req-c361edb4-a581-4f7a-a510-7655c884b6ae service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-099d8172-ff7c-4387-82d8-e35a4095b287 req-c361edb4-a581-4f7a-a510-7655c884b6ae service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-099d8172-ff7c-4387-82d8-e35a4095b287 req-c361edb4-a581-4f7a-a510-7655c884b6ae service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-099d8172-ff7c-4387-82d8-e35a4095b287 req-c361edb4-a581-4f7a-a510-7655c884b6ae service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:16 user nova-compute[75258]: WARNING nova.compute.manager [req-099d8172-ff7c-4387-82d8-e35a4095b287 req-c361edb4-a581-4f7a-a510-7655c884b6ae service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state resized and task_state None.
Nov 14 12:45:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8278MB free_disk=25.252578735351562GB free_vcpus=5 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Applying migration context for instance 675b780c-92f9-41de-9457-ae035af15eeb as it has an incoming, in-progress migration f432c86b-10e8-4911-bf2c-4f5373296505. Migration status is finished {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 12:45:17 user nova-compute[75258]: INFO nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating resource usage from migration f432c86b-10e8-4911-bf2c-4f5373296505
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ac186509-f835-453a-b683-c6d3901babba actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance f91e625f-a68e-4da4-aeb8-067f96d649a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Migration f432c86b-10e8-4911-bf2c-4f5373296505 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=25GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:45:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:45:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:45:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:45:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:45:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:45:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:45:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:45:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:31 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:45:31 user nova-compute[75258]: INFO nova.compute.claims [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Claim successful on node user
Nov 14 12:45:31 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.374s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:45:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.policy [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ecec8040474acc8f5104e2e906d4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4804d74a9a74c02b945b46f8c4e7183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:45:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Creating image(s)
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "/opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "/opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "/opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2d3f3ef1e52b02caacabbfd367a80d51cfc19679" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2d3f3ef1e52b02caacabbfd367a80d51cfc19679" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Successfully created port: c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.part --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.virt.images [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] 7e2e2167-92dd-4467-b8c8-8918acde57a6 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:45:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.part /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.part /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.converted" returned: 0 in 0.276s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Successfully updated port: c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679.converted --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2d3f3ef1e52b02caacabbfd367a80d51cfc19679" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.181s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquired lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing instance network info cache due to event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] Acquiring lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2d3f3ef1e52b02caacabbfd367a80d51cfc19679" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2d3f3ef1e52b02caacabbfd367a80d51cfc19679" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679,backing_fmt=raw /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679,backing_fmt=raw /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk 1073741824" returned: 0 in 0.045s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2d3f3ef1e52b02caacabbfd367a80d51cfc19679" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Releasing lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance network_info: |[{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] Acquired lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:45:33 user nova-compute[75258]: DEBUG nova.network.neutron [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Cannot resize image /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Ensure instance console log exists: /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Start _get_guest_xml network_info=[{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:45:29Z,direct_url=<?>,disk_format='qcow2',id=7e2e2167-92dd-4467-b8c8-8918acde57a6,min_disk=0,min_ram=0,name='tempest-scenario-img--1609394248',owner='c4804d74a9a74c02b945b46f8c4e7183',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:45:30Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '7e2e2167-92dd-4467-b8c8-8918acde57a6'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:34 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:45:29Z,direct_url=<?>,disk_format='qcow2',id=7e2e2167-92dd-4467-b8c8-8918acde57a6,min_disk=0,min_ram=0,name='tempest-scenario-img--1609394248',owner='c4804d74a9a74c02b945b46f8c4e7183',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:45:30Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-531669879',display_name='tempest-TestMinimumBasicScenario-server-531669879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-531669879',id=24,image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO29bUilL5fawEGW6cAeHaeE8XFlTIQMLXwxAAuKiD5ZHgvRu1NB0NNWlX1KAbbqx9bYNwH4/3b7y1z39b8W3rj+AduXrWruaRuz/ztaJObf8rgea6b2vW0q+/RylnwMxA==',key_name='tempest-TestMinimumBasicScenario-1028670539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-pxmq8c15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:45:32Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'pci_devices' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:45:34 user nova-compute[75258]:   <uuid>a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138</uuid>
Nov 14 12:45:34 user nova-compute[75258]:   <name>instance-00000018</name>
Nov 14 12:45:34 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:45:34 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:45:34 user nova-compute[75258]:   <metadata>
Nov 14 12:45:34 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:45:34 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:45:34 user nova-compute[75258]:       <nova:name>tempest-TestMinimumBasicScenario-server-531669879</nova:name>
Nov 14 12:45:34 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:45:34</nova:creationTime>
Nov 14 12:45:34 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:45:34 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:45:34 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:45:34 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:45:34 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:45:34 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:45:34 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:45:34 user nova-compute[75258]:       <nova:owner>
Nov 14 12:45:34 user nova-compute[75258]:         <nova:user uuid="46ecec8040474acc8f5104e2e906d4e8">tempest-TestMinimumBasicScenario-30457951-project-member</nova:user>
Nov 14 12:45:34 user nova-compute[75258]:         <nova:project uuid="c4804d74a9a74c02b945b46f8c4e7183">tempest-TestMinimumBasicScenario-30457951</nova:project>
Nov 14 12:45:34 user nova-compute[75258]:       </nova:owner>
Nov 14 12:45:34 user nova-compute[75258]:       <nova:root type="image" uuid="7e2e2167-92dd-4467-b8c8-8918acde57a6"/>
Nov 14 12:45:34 user nova-compute[75258]:       <nova:ports>
Nov 14 12:45:34 user nova-compute[75258]:         <nova:port uuid="c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036">
Nov 14 12:45:34 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 12:45:34 user nova-compute[75258]:         </nova:port>
Nov 14 12:45:34 user nova-compute[75258]:       </nova:ports>
Nov 14 12:45:34 user nova-compute[75258]:     </nova:instance>
Nov 14 12:45:34 user nova-compute[75258]:   </metadata>
Nov 14 12:45:34 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:45:34 user nova-compute[75258]:     <system>
Nov 14 12:45:34 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:45:34 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:45:34 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:45:34 user nova-compute[75258]:       <entry name="serial">a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138</entry>
Nov 14 12:45:34 user nova-compute[75258]:       <entry name="uuid">a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138</entry>
Nov 14 12:45:34 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:45:34 user nova-compute[75258]:     </system>
Nov 14 12:45:34 user nova-compute[75258]:   </sysinfo>
Nov 14 12:45:34 user nova-compute[75258]:   <os>
Nov 14 12:45:34 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:45:34 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:45:34 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:45:34 user nova-compute[75258]:   </os>
Nov 14 12:45:34 user nova-compute[75258]:   <features>
Nov 14 12:45:34 user nova-compute[75258]:     <acpi/>
Nov 14 12:45:34 user nova-compute[75258]:     <apic/>
Nov 14 12:45:34 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:45:34 user nova-compute[75258]:   </features>
Nov 14 12:45:34 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:45:34 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:45:34 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:45:34 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:45:34 user nova-compute[75258]:   </clock>
Nov 14 12:45:34 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:45:34 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:45:34 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:45:34 user nova-compute[75258]:   </cpu>
Nov 14 12:45:34 user nova-compute[75258]:   <devices>
Nov 14 12:45:34 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:45:34 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:45:34 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk"/>
Nov 14 12:45:34 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:45:34 user nova-compute[75258]:     </disk>
Nov 14 12:45:34 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:45:34 user nova-compute[75258]:       <mac address="fa:16:3e:9a:66:9f"/>
Nov 14 12:45:34 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:45:34 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:45:34 user nova-compute[75258]:       <target dev="tapc9b2ef09-6c"/>
Nov 14 12:45:34 user nova-compute[75258]:     </interface>
Nov 14 12:45:34 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:45:34 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/console.log" append="off"/>
Nov 14 12:45:34 user nova-compute[75258]:     </serial>
Nov 14 12:45:34 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:45:34 user nova-compute[75258]:     <video>
Nov 14 12:45:34 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:45:34 user nova-compute[75258]:     </video>
Nov 14 12:45:34 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:45:34 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:45:34 user nova-compute[75258]:     </rng>
Nov 14 12:45:34 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:45:34 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:45:34 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:45:34 user nova-compute[75258]:     </memballoon>
Nov 14 12:45:34 user nova-compute[75258]:   </devices>
Nov 14 12:45:34 user nova-compute[75258]: </domain>
Nov 14 12:45:34 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-531669879',display_name='tempest-TestMinimumBasicScenario-server-531669879',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-531669879',id=24,image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO29bUilL5fawEGW6cAeHaeE8XFlTIQMLXwxAAuKiD5ZHgvRu1NB0NNWlX1KAbbqx9bYNwH4/3b7y1z39b8W3rj+AduXrWruaRuz/ztaJObf8rgea6b2vW0q+/RylnwMxA==',key_name='tempest-TestMinimumBasicScenario-1028670539',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-pxmq8c15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:45:32Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG os_vif [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33771cbc-afff-53b9-a8d1-63c7973ea252', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.network.neutron [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updated VIF entry in instance network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.network.neutron [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9b2ef09-6c, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9b2ef09-6c, col_values=(('qos', UUID('a93c51a6-40b7-4909-aab2-33475eb6ea4b')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9b2ef09-6c, col_values=(('external_ids', {'iface-id': 'c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:66:9f', 'vm-uuid': 'a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1fb59e2e-0bef-4ffa-b62f-49f55a6e2c05 req-4a3c9711-e24a-4768-acfc-3ded51410a84 service nova] Releasing lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:34 user nova-compute[75258]: INFO os_vif [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c')
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:45:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No VIF found with MAC fa:16:3e:9a:66:9f, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-02a60ed7-0296-4a91-9d8d-1d2dee7e47c1 req-f3598315-4577-4524-90e0-f5fffa980151 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-02a60ed7-0296-4a91-9d8d-1d2dee7e47c1 req-f3598315-4577-4524-90e0-f5fffa980151 service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-02a60ed7-0296-4a91-9d8d-1d2dee7e47c1 req-f3598315-4577-4524-90e0-f5fffa980151 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-02a60ed7-0296-4a91-9d8d-1d2dee7e47c1 req-f3598315-4577-4524-90e0-f5fffa980151 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-02a60ed7-0296-4a91-9d8d-1d2dee7e47c1 req-f3598315-4577-4524-90e0-f5fffa980151 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:35 user nova-compute[75258]: WARNING nova.compute.manager [req-02a60ed7-0296-4a91-9d8d-1d2dee7e47c1 req-f3598315-4577-4524-90e0-f5fffa980151 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received unexpected event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with vm_state building and task_state spawning.
Nov 14 12:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:45:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance spawned successfully.
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:45:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-cf304bcd-a531-4cab-beb9-b52e2b98b67a req-0a85ab66-cc8f-400e-bf2e-ae0d9a590338 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cf304bcd-a531-4cab-beb9-b52e2b98b67a req-0a85ab66-cc8f-400e-bf2e-ae0d9a590338 service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cf304bcd-a531-4cab-beb9-b52e2b98b67a req-0a85ab66-cc8f-400e-bf2e-ae0d9a590338 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cf304bcd-a531-4cab-beb9-b52e2b98b67a req-0a85ab66-cc8f-400e-bf2e-ae0d9a590338 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-cf304bcd-a531-4cab-beb9-b52e2b98b67a req-0a85ab66-cc8f-400e-bf2e-ae0d9a590338 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:38 user nova-compute[75258]: WARNING nova.compute.manager [req-cf304bcd-a531-4cab-beb9-b52e2b98b67a req-0a85ab66-cc8f-400e-bf2e-ae0d9a590338 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received unexpected event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with vm_state building and task_state spawning.
Nov 14 12:45:38 user nova-compute[75258]: INFO nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Took 5.76 seconds to spawn the instance on the hypervisor.
Nov 14 12:45:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:45:38 user nova-compute[75258]: INFO nova.compute.manager [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Took 6.47 seconds to build instance.
Nov 14 12:45:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4adb72a3-a49a-498b-b113-4bec691732f8 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.565s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:45:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:45:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:45:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:58 user nova-compute[75258]: INFO nova.compute.manager [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Terminating instance
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-5f603461-a502-4804-90d8-bbaa32b6a65d req-42629df0-f215-44ef-9b7a-0622c88ee564 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5f603461-a502-4804-90d8-bbaa32b6a65d req-42629df0-f215-44ef-9b7a-0622c88ee564 service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5f603461-a502-4804-90d8-bbaa32b6a65d req-42629df0-f215-44ef-9b7a-0622c88ee564 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5f603461-a502-4804-90d8-bbaa32b6a65d req-42629df0-f215-44ef-9b7a-0622c88ee564 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-5f603461-a502-4804-90d8-bbaa32b6a65d req-42629df0-f215-44ef-9b7a-0622c88ee564 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-5f603461-a502-4804-90d8-bbaa32b6a65d req-42629df0-f215-44ef-9b7a-0622c88ee564 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-unplugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:45:58 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Instance destroyed successfully.
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'resources' on Instance uuid ac186509-f835-453a-b683-c6d3901babba {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1628417232',display_name='tempest-AttachVolumeTestJSON-server-1628417232',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1628417232',id=3,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPod4Y8RXdNP03BmGHZmQ2lcoRmJCS54wPehpb6ArdvY9GPlWE+0oh+WsbIhfVc71HDmcIgqP6a/wlWNeQaV+rsLMei4+uA3q/55D3X1SuMlsL5RH6qYPqjTj378GWhKjQ==',key_name='tempest-keypair-1676443003',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-s10qq8mg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:44:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=ac186509-f835-453a-b683-c6d3901babba,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "address": "fa:16:3e:5e:d1:fb", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.95", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap088cce2a-36", "ovs_interfaceid": "088cce2a-366c-4b1e-a9cd-f9dba80599b0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG os_vif [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap088cce2a-36, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e52545be-4e74-4fab-b2e1-85cf4180f137) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:59 user nova-compute[75258]: INFO os_vif [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:d1:fb,bridge_name='br-int',has_traffic_filtering=True,id=088cce2a-366c-4b1e-a9cd-f9dba80599b0,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap088cce2a-36')
Nov 14 12:45:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Deleting instance files /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba_del
Nov 14 12:45:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Deletion of /opt/stack/data/nova/instances/ac186509-f835-453a-b683-c6d3901babba_del complete
Nov 14 12:45:59 user nova-compute[75258]: INFO nova.compute.manager [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: ac186509-f835-453a-b683-c6d3901babba] Took 0.66 seconds to destroy the instance on the hypervisor.
Nov 14 12:45:59 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:45:59 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:45:59 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: ac186509-f835-453a-b683-c6d3901babba] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:45:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:45:59 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:59 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: ac186509-f835-453a-b683-c6d3901babba] Took 0.68 seconds to deallocate network for instance.
Nov 14 12:45:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-4a405af9-4fa5-4c3d-8d62-66b4a76e3b31 req-6e158af3-bf7c-42c6-b696-6166036e18fd service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-deleted-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:45:59 user nova-compute[75258]: INFO nova.compute.manager [req-4a405af9-4fa5-4c3d-8d62-66b4a76e3b31 req-6e158af3-bf7c-42c6-b696-6166036e18fd service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Neutron deleted interface 088cce2a-366c-4b1e-a9cd-f9dba80599b0; detaching it from the instance and deleting it from the info cache
Nov 14 12:45:59 user nova-compute[75258]: DEBUG nova.network.neutron [req-4a405af9-4fa5-4c3d-8d62-66b4a76e3b31 req-6e158af3-bf7c-42c6-b696-6166036e18fd service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:45:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-4a405af9-4fa5-4c3d-8d62-66b4a76e3b31 req-6e158af3-bf7c-42c6-b696-6166036e18fd service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Detach interface failed, port_id=088cce2a-366c-4b1e-a9cd-f9dba80599b0, reason: Instance ac186509-f835-453a-b683-c6d3901babba could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:45:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:45:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.279s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:00 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Deleted allocations for instance ac186509-f835-453a-b683-c6d3901babba
Nov 14 12:46:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ca1d62ec-5af5-482e-9501-b1bef067353d tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "ac186509-f835-453a-b683-c6d3901babba" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.794s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-c6e21737-0df4-420e-b1fe-8dffcec18721 req-4d81dcde-0bcd-44d7-80c2-1600ab17f786 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6e21737-0df4-420e-b1fe-8dffcec18721 req-4d81dcde-0bcd-44d7-80c2-1600ab17f786 service nova] Acquiring lock "ac186509-f835-453a-b683-c6d3901babba-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6e21737-0df4-420e-b1fe-8dffcec18721 req-4d81dcde-0bcd-44d7-80c2-1600ab17f786 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6e21737-0df4-420e-b1fe-8dffcec18721 req-4d81dcde-0bcd-44d7-80c2-1600ab17f786 service nova] Lock "ac186509-f835-453a-b683-c6d3901babba-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-c6e21737-0df4-420e-b1fe-8dffcec18721 req-4d81dcde-0bcd-44d7-80c2-1600ab17f786 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] No waiting events found dispatching network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:00 user nova-compute[75258]: WARNING nova.compute.manager [req-c6e21737-0df4-420e-b1fe-8dffcec18721 req-4d81dcde-0bcd-44d7-80c2-1600ab17f786 service nova] [instance: ac186509-f835-453a-b683-c6d3901babba] Received unexpected event network-vif-plugged-088cce2a-366c-4b1e-a9cd-f9dba80599b0 for instance with vm_state deleted and task_state None.
Nov 14 12:46:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:46:10 user nova-compute[75258]: INFO nova.compute.claims [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Claim successful on node user
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.386s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:46:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.policy [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '974df2b5a20f414eadb9e84383523e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dc8f5ff4bf4a4788a2f7ec14b844f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:46:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Creating image(s)
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.216s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk 1073741824" returned: 0 in 0.051s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.275s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Successfully created port: 96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Cannot resize image /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Ensure instance console log exists: /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Successfully updated port: 96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquired lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-changed-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Refreshing instance network info cache due to event network-changed-96918577-6f0a-4f2d-b038-8b1245a6a931. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:46:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] Acquiring lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updating instance_info_cache with network_info: [{"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Releasing lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance network_info: |[{"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] Acquired lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Refreshing network info cache for port 96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Start _get_guest_xml network_info=[{"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:46:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-715727060',display_name='tempest-tempest.common.compute-instance-715727060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-715727060',id=25,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6nOBmZS16HrsAcRDVYl1N9VVZlKCYS7vsVvKoBzd7OKlnMV1+Jxm/buZP9fLrIbNZp7VauNlpAeDzgdQNI3huVDLpo9eCIQ/k9KMnvgkmlp4agFaOxDXYwrXHYbT2qbQ==',key_name='tempest-keypair-149773274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-buwy3nts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=7cadfc3a-d7a8-433e-b35e-c4021d78c529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'pci_devices' on Instance uuid 7cadfc3a-d7a8-433e-b35e-c4021d78c529 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:46:12 user nova-compute[75258]:   <uuid>7cadfc3a-d7a8-433e-b35e-c4021d78c529</uuid>
Nov 14 12:46:12 user nova-compute[75258]:   <name>instance-00000019</name>
Nov 14 12:46:12 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:46:12 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:46:12 user nova-compute[75258]:   <metadata>
Nov 14 12:46:12 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:46:12 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:46:12 user nova-compute[75258]:       <nova:name>tempest-tempest.common.compute-instance-715727060</nova:name>
Nov 14 12:46:12 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:46:12</nova:creationTime>
Nov 14 12:46:12 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:46:12 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:46:12 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:46:12 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:46:12 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:46:12 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:46:12 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:46:12 user nova-compute[75258]:       <nova:owner>
Nov 14 12:46:12 user nova-compute[75258]:         <nova:user uuid="974df2b5a20f414eadb9e84383523e4f">tempest-ServerActionsTestOtherA-1553354563-project-member</nova:user>
Nov 14 12:46:12 user nova-compute[75258]:         <nova:project uuid="a6dc8f5ff4bf4a4788a2f7ec14b844f5">tempest-ServerActionsTestOtherA-1553354563</nova:project>
Nov 14 12:46:12 user nova-compute[75258]:       </nova:owner>
Nov 14 12:46:12 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:46:12 user nova-compute[75258]:       <nova:ports>
Nov 14 12:46:12 user nova-compute[75258]:         <nova:port uuid="96918577-6f0a-4f2d-b038-8b1245a6a931">
Nov 14 12:46:12 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 12:46:12 user nova-compute[75258]:         </nova:port>
Nov 14 12:46:12 user nova-compute[75258]:       </nova:ports>
Nov 14 12:46:12 user nova-compute[75258]:     </nova:instance>
Nov 14 12:46:12 user nova-compute[75258]:   </metadata>
Nov 14 12:46:12 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:46:12 user nova-compute[75258]:     <system>
Nov 14 12:46:12 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:46:12 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:46:12 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:46:12 user nova-compute[75258]:       <entry name="serial">7cadfc3a-d7a8-433e-b35e-c4021d78c529</entry>
Nov 14 12:46:12 user nova-compute[75258]:       <entry name="uuid">7cadfc3a-d7a8-433e-b35e-c4021d78c529</entry>
Nov 14 12:46:12 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:46:12 user nova-compute[75258]:     </system>
Nov 14 12:46:12 user nova-compute[75258]:   </sysinfo>
Nov 14 12:46:12 user nova-compute[75258]:   <os>
Nov 14 12:46:12 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:46:12 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:46:12 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:46:12 user nova-compute[75258]:   </os>
Nov 14 12:46:12 user nova-compute[75258]:   <features>
Nov 14 12:46:12 user nova-compute[75258]:     <acpi/>
Nov 14 12:46:12 user nova-compute[75258]:     <apic/>
Nov 14 12:46:12 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:46:12 user nova-compute[75258]:   </features>
Nov 14 12:46:12 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:46:12 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:46:12 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:46:12 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:46:12 user nova-compute[75258]:   </clock>
Nov 14 12:46:12 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:46:12 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:46:12 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:46:12 user nova-compute[75258]:   </cpu>
Nov 14 12:46:12 user nova-compute[75258]:   <devices>
Nov 14 12:46:12 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:46:12 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:46:12 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk"/>
Nov 14 12:46:12 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:46:12 user nova-compute[75258]:     </disk>
Nov 14 12:46:12 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:46:12 user nova-compute[75258]:       <mac address="fa:16:3e:13:56:7b"/>
Nov 14 12:46:12 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:46:12 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:46:12 user nova-compute[75258]:       <target dev="tap96918577-6f"/>
Nov 14 12:46:12 user nova-compute[75258]:     </interface>
Nov 14 12:46:12 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:46:12 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/console.log" append="off"/>
Nov 14 12:46:12 user nova-compute[75258]:     </serial>
Nov 14 12:46:12 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:46:12 user nova-compute[75258]:     <video>
Nov 14 12:46:12 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:46:12 user nova-compute[75258]:     </video>
Nov 14 12:46:12 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:46:12 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:46:12 user nova-compute[75258]:     </rng>
Nov 14 12:46:12 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:46:12 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:46:12 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:46:12 user nova-compute[75258]:     </memballoon>
Nov 14 12:46:12 user nova-compute[75258]:   </devices>
Nov 14 12:46:12 user nova-compute[75258]: </domain>
Nov 14 12:46:12 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-715727060',display_name='tempest-tempest.common.compute-instance-715727060',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-715727060',id=25,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6nOBmZS16HrsAcRDVYl1N9VVZlKCYS7vsVvKoBzd7OKlnMV1+Jxm/buZP9fLrIbNZp7VauNlpAeDzgdQNI3huVDLpo9eCIQ/k9KMnvgkmlp4agFaOxDXYwrXHYbT2qbQ==',key_name='tempest-keypair-149773274',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-buwy3nts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:46:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=7cadfc3a-d7a8-433e-b35e-c4021d78c529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG os_vif [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dfd1237-becc-57df-bbe4-821d7c01ccf2', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96918577-6f, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96918577-6f, col_values=(('qos', UUID('78a592f3-4106-4ced-bddc-e0eb33541776')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96918577-6f, col_values=(('external_ids', {'iface-id': '96918577-6f0a-4f2d-b038-8b1245a6a931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:56:7b', 'vm-uuid': '7cadfc3a-d7a8-433e-b35e-c4021d78c529'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:12 user nova-compute[75258]: INFO os_vif [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f')
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No VIF found with MAC fa:16:3e:13:56:7b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updated VIF entry in instance network info cache for port 96918577-6f0a-4f2d-b038-8b1245a6a931. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updating instance_info_cache with network_info: [{"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:46:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9919873a-7f31-477d-be6f-b1b5391a1345 req-2bd19fc8-6f6d-498c-8c10-5e4496c69d18 service nova] Releasing lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:46:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-872ed9c4-7b88-484e-ba65-b78fbf079575 req-867315ba-8f5c-4cd2-b95f-bac2759e7f6f service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-872ed9c4-7b88-484e-ba65-b78fbf079575 req-867315ba-8f5c-4cd2-b95f-bac2759e7f6f service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-872ed9c4-7b88-484e-ba65-b78fbf079575 req-867315ba-8f5c-4cd2-b95f-bac2759e7f6f service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-872ed9c4-7b88-484e-ba65-b78fbf079575 req-867315ba-8f5c-4cd2-b95f-bac2759e7f6f service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-872ed9c4-7b88-484e-ba65-b78fbf079575 req-867315ba-8f5c-4cd2-b95f-bac2759e7f6f service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:14 user nova-compute[75258]: WARNING nova.compute.manager [req-872ed9c4-7b88-484e-ba65-b78fbf079575 req-867315ba-8f5c-4cd2-b95f-bac2759e7f6f service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received unexpected event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with vm_state building and task_state spawning.
Nov 14 12:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:46:16 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance spawned successfully.
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-23b2efdf-ad4a-42c2-a833-dd5510f2a903 req-b6627352-bf37-4153-94f0-5f2a3b50aa66 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-23b2efdf-ad4a-42c2-a833-dd5510f2a903 req-b6627352-bf37-4153-94f0-5f2a3b50aa66 service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-23b2efdf-ad4a-42c2-a833-dd5510f2a903 req-b6627352-bf37-4153-94f0-5f2a3b50aa66 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-23b2efdf-ad4a-42c2-a833-dd5510f2a903 req-b6627352-bf37-4153-94f0-5f2a3b50aa66 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-23b2efdf-ad4a-42c2-a833-dd5510f2a903 req-b6627352-bf37-4153-94f0-5f2a3b50aa66 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:16 user nova-compute[75258]: WARNING nova.compute.manager [req-23b2efdf-ad4a-42c2-a833-dd5510f2a903 req-b6627352-bf37-4153-94f0-5f2a3b50aa66 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received unexpected event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with vm_state building and task_state spawning.
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:16 user nova-compute[75258]: INFO nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Took 5.40 seconds to spawn the instance on the hypervisor.
Nov 14 12:46:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:16 user nova-compute[75258]: INFO nova.compute.manager [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Took 6.14 seconds to build instance.
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a7adef90-b264-452d-828f-4f07dc674f86 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.263s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.217s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8135MB free_disk=25.186965942382812GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Applying migration context for instance 675b780c-92f9-41de-9457-ae035af15eeb as it has an incoming, in-progress migration f432c86b-10e8-4911-bf2c-4f5373296505. Migration status is finished {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 12:46:18 user nova-compute[75258]: INFO nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating resource usage from migration f432c86b-10e8-4911-bf2c-4f5373296505
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance f91e625f-a68e-4da4-aeb8-067f96d649a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Migration f432c86b-10e8-4911-bf2c-4f5373296505 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=26GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:46:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.516s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:46:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:46:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:46:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:46:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:46:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:46:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:46:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:33 user nova-compute[75258]: DEBUG nova.compute.manager [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:46:33 user nova-compute[75258]: INFO nova.compute.manager [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] instance snapshotting
Nov 14 12:46:33 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Beginning live snapshot process
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json -f qcow2" returned: 0 in 0.165s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json -f qcow2" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.229s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk8b0it9o/15d68245ebf84dae8c0e27f083aa290a.delta 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpk8b0it9o/15d68245ebf84dae8c0e27f083aa290a.delta 1073741824" returned: 0 in 0.063s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:34 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 12:46:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:46:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:46:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 12:46:36 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:46:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk8b0it9o/15d68245ebf84dae8c0e27f083aa290a.delta /opt/stack/data/nova/instances/snapshots/tmpk8b0it9o/15d68245ebf84dae8c0e27f083aa290a {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpk8b0it9o/15d68245ebf84dae8c0e27f083aa290a.delta /opt/stack/data/nova/instances/snapshots/tmpk8b0it9o/15d68245ebf84dae8c0e27f083aa290a" returned: 0 in 0.572s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Snapshot extracted, beginning image upload
Nov 14 12:46:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:38 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Snapshot image upload complete
Nov 14 12:46:38 user nova-compute[75258]: INFO nova.compute.manager [None req-c4e965c0-8ff1-4432-8f42-65e57bc25b36 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Took 5.01 seconds to snapshot the instance on the hypervisor.
Nov 14 12:46:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-changed-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Refreshing instance network info cache due to event network-changed-7226e7fb-4e03-4182-a445-a30648b37027. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:46:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] Acquiring lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:46:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] Acquired lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:46:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Refreshing network info cache for port 7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updated VIF entry in instance network info cache for port 7226e7fb-4e03-4182-a445-a30648b37027. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updating instance_info_cache with network_info: [{"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd3af999-35da-4efc-bd77-9a03420031f1 req-7e62488c-84cf-4304-9e44-6fc07042d9f2 service nova] Releasing lock "refresh_cache-f91e625f-a68e-4da4-aeb8-067f96d649a2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:47 user nova-compute[75258]: INFO nova.compute.manager [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Rebuilding instance
Nov 14 12:46:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-88ac4b0d-3e24-40e4-b6ea-8e486dedfcb3 req-86fb32c8-0066-47c5-8bf6-18c0778ea2a9 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-unplugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-88ac4b0d-3e24-40e4-b6ea-8e486dedfcb3 req-86fb32c8-0066-47c5-8bf6-18c0778ea2a9 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-88ac4b0d-3e24-40e4-b6ea-8e486dedfcb3 req-86fb32c8-0066-47c5-8bf6-18c0778ea2a9 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-88ac4b0d-3e24-40e4-b6ea-8e486dedfcb3 req-86fb32c8-0066-47c5-8bf6-18c0778ea2a9 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-88ac4b0d-3e24-40e4-b6ea-8e486dedfcb3 req-86fb32c8-0066-47c5-8bf6-18c0778ea2a9 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No waiting events found dispatching network-vif-unplugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:48 user nova-compute[75258]: WARNING nova.compute.manager [req-88ac4b0d-3e24-40e4-b6ea-8e486dedfcb3 req-86fb32c8-0066-47c5-8bf6-18c0778ea2a9 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received unexpected event network-vif-unplugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with vm_state active and task_state rebuilding.
Nov 14 12:46:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance destroyed successfully.
Nov 14 12:46:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance destroyed successfully.
Nov 14 12:46:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1833133202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1871672058',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ4EpalNHCuF/5YOtbe9vY1rDMtV3ANQJGWd7bNGBYdS3J6OMVDpSn+QMjc5MdIMPIZVzscHiy5W+ETizBVxNGIKcEQFM+4lsGLUuCbAPdQKTUdKxiCItircAwA8jYSwA==',key_name='tempest-keypair-872410949',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6554d9e28ce942b5933421198c41ff9a',ramdisk_id='',reservation_id='r-2p0el8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1507651178',owner_user_name='tempest-ServerActionsV293TestJSON-1507651178-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:46:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ab782add99f4231b2d7bbfd078edf62',uuid=f91e625f-a68e-4da4-aeb8-067f96d649a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converting VIF {"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_vif [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7226e7fb-4e, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=792c6aec-238a-4a59-af5f-b37abc315c28) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:48 user nova-compute[75258]: INFO os_vif [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e')
Nov 14 12:46:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:46:48 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3bf9843-b271-4468-9b16-697386ab3ddf]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:46:48 user nova-compute[75258]: No targets found.
Nov 14 12:46:48 user nova-compute[75258]: iSNS:
Nov 14 12:46:48 user nova-compute[75258]: No targets found.
Nov 14 12:46:48 user nova-compute[75258]: STATIC:
Nov 14 12:46:48 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:46:48 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:46:48 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:46:48 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13
Nov 14 12:46:48 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:46:48 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:46:48 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:46:48 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:46:48 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:46:48 user nova-compute[75258]: FIRMWARE:
Nov 14 12:46:48 user nova-compute[75258]: No targets found.
Nov 14 12:46:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:46:48 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:46:48 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[986013e0-8c86-4098-bf16-b61594d395fa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0df523a6-b502-4b81-88b7-91fab398a3d8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:48 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:46:48 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:46:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:48 user nova-compute[75258]: tcp: [31] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:46:48 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:46:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b4080550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5213cd0-fb0d-4ece-af7c-991d98bb0741]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3ea9e29-128a-40b0-bf73-73f89fa9098a]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e441690-0200-4899-b27f-eacb9df01aed]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[82880208-e1b9-4223-86c8-2b53d183b6a2]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bb27d7ff', '/dev/disk/by-id/scsi-1SCST_BIObb27d7ff-8d04f418ee80a99f', '/dev/disk/by-id/scsi-23864303466343138') {{(pid=86014) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a6284b1-c676-4b5a-abdf-cf8c81f4686f]: (4, None) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfa12ab5-4493-4b1a-ae12-65fb401f9bb1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b80e2ac-47fc-4a4d-ba8d-b9be4761e2de]: (4, ('Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]\nLogout of [sid: 31, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 31, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]
Nov 14 12:46:48 user nova-compute[75258]: Logout of [sid: 31, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.
Nov 14 12:46:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ba214-8763-407a-b484-695aec608a70]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] <== disconnect_volume: return (334ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:46:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:46:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Deleting instance files /opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2_del
Nov 14 12:46:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Deletion of /opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2_del complete
Nov 14 12:46:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance f91e625f-a68e-4da4-aeb8-067f96d649a2 could not be found.
Nov 14 12:46:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:46:49 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b92c90bc-252e-4644-baa0-d069c7ded4be]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:46:49 user nova-compute[75258]: No targets found.
Nov 14 12:46:49 user nova-compute[75258]: iSNS:
Nov 14 12:46:49 user nova-compute[75258]: No targets found.
Nov 14 12:46:49 user nova-compute[75258]: STATIC:
Nov 14 12:46:49 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:46:49 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:46:49 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:46:49 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:46:49 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:46:49 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:46:49 user nova-compute[75258]: FIRMWARE:
Nov 14 12:46:49 user nova-compute[75258]: No targets found.
Nov 14 12:46:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:46:49 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:46:49 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[75bc46fa-909b-4a03-91a9-ecf51e2d0667]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea7b20e2-3f45-408a-9691-b728693c2cd2]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:49 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:46:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:49 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:46:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c622f80>, {}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Disconnecting from: [] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.075s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] <== disconnect_volume: return (76ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Preparing to wait for external event volume-reimaged-dce3d526-3833-4dde-ab66-ffe18b83de13 {{(pid=75258) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Port f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 binding to destination host user is already ACTIVE {{(pid=75258) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-59551316-f0b5-42b7-85cc-9a663fadb13b req-b21df567-c21f-4c41-bddd-92f98f2bcd07 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59551316-f0b5-42b7-85cc-9a663fadb13b req-b21df567-c21f-4c41-bddd-92f98f2bcd07 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59551316-f0b5-42b7-85cc-9a663fadb13b req-b21df567-c21f-4c41-bddd-92f98f2bcd07 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59551316-f0b5-42b7-85cc-9a663fadb13b req-b21df567-c21f-4c41-bddd-92f98f2bcd07 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-59551316-f0b5-42b7-85cc-9a663fadb13b req-b21df567-c21f-4c41-bddd-92f98f2bcd07 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No event matching network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 in dict_keys([('volume-reimaged', 'dce3d526-3833-4dde-ab66-ffe18b83de13')]) {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:325}}
Nov 14 12:46:50 user nova-compute[75258]: WARNING nova.compute.manager [req-59551316-f0b5-42b7-85cc-9a663fadb13b req-b21df567-c21f-4c41-bddd-92f98f2bcd07 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received unexpected event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with vm_state active and task_state rebuilding.
Nov 14 12:46:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Creating tmpfile /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/tmpbym1u9po to verify with other compute node that the instance is on the same shared storage. {{(pid=75258) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9628}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance destroyed successfully.
Nov 14 12:46:51 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lazy-loading 'resources' on Instance uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:45:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_vif [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fe5608-d5, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4f2a2e63-448a-4c94-bba5-e1e9733b3b99) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:51 user nova-compute[75258]: INFO os_vif [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5')
Nov 14 12:46:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:46:51 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2213525d-aeef-4026-86d1-4868156a367f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:46:51 user nova-compute[75258]: No targets found.
Nov 14 12:46:51 user nova-compute[75258]: iSNS:
Nov 14 12:46:51 user nova-compute[75258]: No targets found.
Nov 14 12:46:51 user nova-compute[75258]: STATIC:
Nov 14 12:46:51 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:46:51 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:46:51 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:46:51 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:46:51 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:46:51 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:46:51 user nova-compute[75258]: FIRMWARE:
Nov 14 12:46:51 user nova-compute[75258]: No targets found.
Nov 14 12:46:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:46:51 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:46:51 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[198e17b3-12eb-4faf-ad78-82c4659a6648]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d11ea42-0408-45da-bb47-c6cb072000b6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:51 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:46:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:51 user nova-compute[75258]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:46:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b4500f70>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd124079-602c-4b85-8637-218a9517f93b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9244114-f7d0-42da-80ae-55c9edad70ed]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71bad93-e871-4bee-8156-97eea5f16f40]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32eed7bf-f209-4ccf-b53e-fe2e1f1fffc6]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9530dd3-d4c3-4613-a008-760d2dc1cd98]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.043s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cf7c929-f98b-4e5c-bb71-b91d1ef6363b]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]
Nov 14 12:46:51 user nova-compute[75258]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.
Nov 14 12:46:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d058ee6-f3b6-4f0f-9a29-75ceff4a5c9b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.287s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== disconnect_volume: return (289ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:46:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:52 user nova-compute[75258]: WARNING nova.compute.manager [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state resized and task_state resize_reverting.
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:52 user nova-compute[75258]: WARNING nova.compute.manager [req-59839330-13f8-49b8-9cb4-902e48c28bcc req-ae316110-6d19-44e7-a605-cef82269caf6 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state resized and task_state resize_reverting.
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lazy-loading 'migration_context' on Instance uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.objects.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Object Instance<675b780c-92f9-41de-9457-ae035af15eeb> lazy-loaded attributes: resources,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.398s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.210s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:46:52 user nova-compute[75258]: INFO nova.compute.claims [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Claim successful on node user
Nov 14 12:46:53 user nova-compute[75258]: INFO nova.compute.manager [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Swapping old allocation on dict_keys(['57b222fc-6379-46c4-a979-ca3142626f72']) held by migration f432c86b-10e8-4911-bf2c-4f5373296505 for instance
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Overwriting current allocation {'allocations': {'57b222fc-6379-46c4-a979-ca3142626f72': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 30}}, 'project_id': 'e3597e92033a4fedafa79d98540cc451', 'user_id': '873cb2d85dba423c89f8a4fd99377a14', 'consumer_generation': 1} on consumer 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.442s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.network.neutron [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:46:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.policy [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '807e1725870b4bca88785bd3f81aa06b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '84d45cf00d6749eabfd3bc56b38a5d4a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:46:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Creating image(s)
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "/opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "/opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "/opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.203s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG os_brick.utils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[192bf648-4301-4adc-84ff-8701b493b7a1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e190352-bd4f-48dc-854d-4ccfedbd3fbb]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d056c81-1bf8-4899-ba24-a9960aa3f489]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c5ddda8-d9c1-4a17-ac30-0b1dbf9256e0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:46:54 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7707901f-26d1-4333-acbf-f22e48dabde4]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG os_brick.utils [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== get_connector_properties: return (155ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk 1073741824" returned: 0 in 0.060s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Cannot resize image /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Ensure instance console log exists: /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:54 user nova-compute[75258]: DEBUG nova.network.neutron [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Successfully created port: 58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Successfully updated port: 58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquired lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received event network-changed-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Refreshing instance network info cache due to event network-changed-58f18176-e928-4502-8e57-91ebb665a1a7. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] Acquiring lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updating instance_info_cache with network_info: [{"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Releasing lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Instance network_info: |[{"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] Acquired lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.neutron [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Refreshing network info cache for port 58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Start _get_guest_xml network_info=[{"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:46:55 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:55 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1773158513',display_name='tempest-AttachVolumeTestJSON-server-1773158513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1773158513',id=26,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoAB0Lv603GBKpm31SuEIVosbX1KOCr4MBU7xGFxcmYubPLyOq8oesu6Jw89/J4M9PmpjbLq51ckW33Q2KtHdn1SkVbV72KeF7TDaTR8t+SfWCig5E9CVJIdR72vaawPw==',key_name='tempest-keypair-1592269227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-8mz1db88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=b498699b-b5f8-4428-bcde-b2893f600dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:8d,bridge_name='br-int',has_traffic_filtering=True,id=58f18176-e928-4502-8e57-91ebb665a1a7,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f18176-e9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.objects.instance [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'pci_devices' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:46:55 user nova-compute[75258]:   <uuid>b498699b-b5f8-4428-bcde-b2893f600dc1</uuid>
Nov 14 12:46:55 user nova-compute[75258]:   <name>instance-0000001a</name>
Nov 14 12:46:55 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:46:55 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:46:55 user nova-compute[75258]:   <metadata>
Nov 14 12:46:55 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:46:55 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:46:55 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeTestJSON-server-1773158513</nova:name>
Nov 14 12:46:55 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:46:55</nova:creationTime>
Nov 14 12:46:55 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:46:55 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:46:55 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:46:55 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:46:55 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:46:55 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:46:55 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:46:55 user nova-compute[75258]:       <nova:owner>
Nov 14 12:46:55 user nova-compute[75258]:         <nova:user uuid="807e1725870b4bca88785bd3f81aa06b">tempest-AttachVolumeTestJSON-528350005-project-member</nova:user>
Nov 14 12:46:55 user nova-compute[75258]:         <nova:project uuid="84d45cf00d6749eabfd3bc56b38a5d4a">tempest-AttachVolumeTestJSON-528350005</nova:project>
Nov 14 12:46:55 user nova-compute[75258]:       </nova:owner>
Nov 14 12:46:55 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:46:55 user nova-compute[75258]:       <nova:ports>
Nov 14 12:46:55 user nova-compute[75258]:         <nova:port uuid="58f18176-e928-4502-8e57-91ebb665a1a7">
Nov 14 12:46:55 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 12:46:55 user nova-compute[75258]:         </nova:port>
Nov 14 12:46:55 user nova-compute[75258]:       </nova:ports>
Nov 14 12:46:55 user nova-compute[75258]:     </nova:instance>
Nov 14 12:46:55 user nova-compute[75258]:   </metadata>
Nov 14 12:46:55 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:46:55 user nova-compute[75258]:     <system>
Nov 14 12:46:55 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:46:55 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:46:55 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:46:55 user nova-compute[75258]:       <entry name="serial">b498699b-b5f8-4428-bcde-b2893f600dc1</entry>
Nov 14 12:46:55 user nova-compute[75258]:       <entry name="uuid">b498699b-b5f8-4428-bcde-b2893f600dc1</entry>
Nov 14 12:46:55 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:46:55 user nova-compute[75258]:     </system>
Nov 14 12:46:55 user nova-compute[75258]:   </sysinfo>
Nov 14 12:46:55 user nova-compute[75258]:   <os>
Nov 14 12:46:55 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:46:55 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:46:55 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:46:55 user nova-compute[75258]:   </os>
Nov 14 12:46:55 user nova-compute[75258]:   <features>
Nov 14 12:46:55 user nova-compute[75258]:     <acpi/>
Nov 14 12:46:55 user nova-compute[75258]:     <apic/>
Nov 14 12:46:55 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:46:55 user nova-compute[75258]:   </features>
Nov 14 12:46:55 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:46:55 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:46:55 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:46:55 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:46:55 user nova-compute[75258]:   </clock>
Nov 14 12:46:55 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:46:55 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:46:55 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:46:55 user nova-compute[75258]:   </cpu>
Nov 14 12:46:55 user nova-compute[75258]:   <devices>
Nov 14 12:46:55 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:46:55 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:46:55 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk"/>
Nov 14 12:46:55 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:46:55 user nova-compute[75258]:     </disk>
Nov 14 12:46:55 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:46:55 user nova-compute[75258]:       <mac address="fa:16:3e:23:6e:8d"/>
Nov 14 12:46:55 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:46:55 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:46:55 user nova-compute[75258]:       <target dev="tap58f18176-e9"/>
Nov 14 12:46:55 user nova-compute[75258]:     </interface>
Nov 14 12:46:55 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:46:55 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/console.log" append="off"/>
Nov 14 12:46:55 user nova-compute[75258]:     </serial>
Nov 14 12:46:55 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:46:55 user nova-compute[75258]:     <video>
Nov 14 12:46:55 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:46:55 user nova-compute[75258]:     </video>
Nov 14 12:46:55 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:46:55 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:46:55 user nova-compute[75258]:     </rng>
Nov 14 12:46:55 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:46:55 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:46:55 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:46:55 user nova-compute[75258]:     </memballoon>
Nov 14 12:46:55 user nova-compute[75258]:   </devices>
Nov 14 12:46:55 user nova-compute[75258]: </domain>
Nov 14 12:46:55 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1773158513',display_name='tempest-AttachVolumeTestJSON-server-1773158513',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1773158513',id=26,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoAB0Lv603GBKpm31SuEIVosbX1KOCr4MBU7xGFxcmYubPLyOq8oesu6Jw89/J4M9PmpjbLq51ckW33Q2KtHdn1SkVbV72KeF7TDaTR8t+SfWCig5E9CVJIdR72vaawPw==',key_name='tempest-keypair-1592269227',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-8mz1db88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:46:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=b498699b-b5f8-4428-bcde-b2893f600dc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:8d,bridge_name='br-int',has_traffic_filtering=True,id=58f18176-e928-4502-8e57-91ebb665a1a7,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f18176-e9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG os_vif [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:8d,bridge_name='br-int',has_traffic_filtering=True,id=58f18176-e928-4502-8e57-91ebb665a1a7,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f18176-e9') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7ac15745-1e84-5b4e-bcf0-36471f7b3cea', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap58f18176-e9, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap58f18176-e9, col_values=(('qos', UUID('b2b854e7-7b3e-4690-9e7f-dfd83b89a795')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap58f18176-e9, col_values=(('external_ids', {'iface-id': '58f18176-e928-4502-8e57-91ebb665a1a7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:23:6e:8d', 'vm-uuid': 'b498699b-b5f8-4428-bcde-b2893f600dc1'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:55 user nova-compute[75258]: INFO os_vif [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:23:6e:8d,bridge_name='br-int',has_traffic_filtering=True,id=58f18176-e928-4502-8e57-91ebb665a1a7,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f18176-e9')
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:46:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No VIF found with MAC fa:16:3e:23:6e:8d, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:46:56 user nova-compute[75258]: DEBUG nova.network.neutron [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updated VIF entry in instance network info cache for port 58f18176-e928-4502-8e57-91ebb665a1a7. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:46:56 user nova-compute[75258]: DEBUG nova.network.neutron [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updating instance_info_cache with network_info: [{"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:46:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b6d7b1f2-da93-45ed-9f20-a0aa953029e9 req-14d9eef9-fe91-4535-a510-07664061e376 service nova] Releasing lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-4cdaa15d-6f70-4f2d-9865-f51b95f5bff0 req-15334615-e8a7-4205-b2d9-198044e8d9fd service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received event network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4cdaa15d-6f70-4f2d-9865-f51b95f5bff0 req-15334615-e8a7-4205-b2d9-198044e8d9fd service nova] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4cdaa15d-6f70-4f2d-9865-f51b95f5bff0 req-15334615-e8a7-4205-b2d9-198044e8d9fd service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4cdaa15d-6f70-4f2d-9865-f51b95f5bff0 req-15334615-e8a7-4205-b2d9-198044e8d9fd service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-4cdaa15d-6f70-4f2d-9865-f51b95f5bff0 req-15334615-e8a7-4205-b2d9-198044e8d9fd service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] No waiting events found dispatching network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:57 user nova-compute[75258]: WARNING nova.compute.manager [req-4cdaa15d-6f70-4f2d-9865-f51b95f5bff0 req-15334615-e8a7-4205-b2d9-198044e8d9fd service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received unexpected event network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 for instance with vm_state building and task_state spawning.
Nov 14 12:46:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Starting finish_revert_migration {{(pid=75258) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Start _get_guest_xml network_info=[{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '675b780c-92f9-41de-9457-ae035af15eeb', 'attached_at': '2023-11-14T12:46:59.000000', 'detached_at': '', 'volume_id': '6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'serial': '6120e31a-3661-4d2d-a8cf-34fbd55386c8'}, 'device_type': 'disk', 'attachment_id': '07ffa007-57d5-4514-9d83-8a6da1417dc0', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:46:58 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:58 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:46:58 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lazy-loading 'vcpu_model' on Instance uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:46:59 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:46:59 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:46:59 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a11079c7-9786-4ca2-b3da-cb6c5cf6806a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:46:59 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8088d0-a7ec-44f5-ab95-a106e3e24a9a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8] added
Nov 14 12:46:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11473e05-e6e4-482c-a180-6014d69fa61a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fee5e16-47ee-4c03-ad69-6c41ce85a5d9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxgHMlwq {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YxgHMlwq" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbb3fa3e-4be4-4d8c-9d31-eeda74fa16c9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YxgHMlwq'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.065s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bb3dea6-9427-44a9-b00f-b082063561ea]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd2759d7-0214-4758-9963-a61ba06ba129]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:59 user nova-compute[75258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:46:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:46:59 user nova-compute[75258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:46:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:46:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Instance spawned successfully.
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-a47e19a4-71f3-4217-9dd8-d04e06634d86 req-9d619c19-c947-4b94-b7ec-2015bef24fec service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received event network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a47e19a4-71f3-4217-9dd8-d04e06634d86 req-9d619c19-c947-4b94-b7ec-2015bef24fec service nova] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a47e19a4-71f3-4217-9dd8-d04e06634d86 req-9d619c19-c947-4b94-b7ec-2015bef24fec service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a47e19a4-71f3-4217-9dd8-d04e06634d86 req-9d619c19-c947-4b94-b7ec-2015bef24fec service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-a47e19a4-71f3-4217-9dd8-d04e06634d86 req-9d619c19-c947-4b94-b7ec-2015bef24fec service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] No waiting events found dispatching network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:46:59 user nova-compute[75258]: WARNING nova.compute.manager [req-a47e19a4-71f3-4217-9dd8-d04e06634d86 req-9d619c19-c947-4b94-b7ec-2015bef24fec service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received unexpected event network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 for instance with vm_state building and task_state spawning.
Nov 14 12:46:59 user nova-compute[75258]: INFO nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Took 5.74 seconds to spawn the instance on the hypervisor.
Nov 14 12:46:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:46:59 user nova-compute[75258]: INFO nova.compute.manager [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Took 6.75 seconds to build instance.
Nov 14 12:46:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-87eb40a4-ac1b-4311-9728-4d3e773c4749 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.963s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --login" returned: 0 in 1.069s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d7d4eff-b814-4e55-bc2a-0ff5aabdc063]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]
Nov 14 12:47:00 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.
Nov 14 12:47:00 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c060441f-36e9-478c-aef0-a9ab72fe36a4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c609f-329f-4730-988a-37f366ddec2f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:00 user nova-compute[75258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:00 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:00 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:00 user nova-compute[75258]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:00 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:00 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.344s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] HCTL ('35', '-', '-', 0) found on session 34 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ff156a4-d68a-4b74-b193-1761387a18dc]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:47:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Searching for a device in session 34 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.374s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== connect_volume: return (2375ms) {'type': 'block', 'scsi_wwn': '26163643339343635', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26163643339343635', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:47:01 user nova-compute[75258]:   <uuid>675b780c-92f9-41de-9457-ae035af15eeb</uuid>
Nov 14 12:47:01 user nova-compute[75258]:   <name>instance-00000013</name>
Nov 14 12:47:01 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:47:01 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:47:01 user nova-compute[75258]:   <metadata>
Nov 14 12:47:01 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:47:01 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:47:01 user nova-compute[75258]:       <nova:name>tempest-ServerActionsTestOtherB-server-112003904</nova:name>
Nov 14 12:47:01 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:46:58</nova:creationTime>
Nov 14 12:47:01 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:47:01 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:47:01 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:47:01 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:47:01 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:47:01 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:47:01 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:47:01 user nova-compute[75258]:       <nova:owner>
Nov 14 12:47:01 user nova-compute[75258]:         <nova:user uuid="873cb2d85dba423c89f8a4fd99377a14">tempest-ServerActionsTestOtherB-1658255901-project-member</nova:user>
Nov 14 12:47:01 user nova-compute[75258]:         <nova:project uuid="e3597e92033a4fedafa79d98540cc451">tempest-ServerActionsTestOtherB-1658255901</nova:project>
Nov 14 12:47:01 user nova-compute[75258]:       </nova:owner>
Nov 14 12:47:01 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:47:01 user nova-compute[75258]:       <nova:ports>
Nov 14 12:47:01 user nova-compute[75258]:         <nova:port uuid="f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40">
Nov 14 12:47:01 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 12:47:01 user nova-compute[75258]:         </nova:port>
Nov 14 12:47:01 user nova-compute[75258]:       </nova:ports>
Nov 14 12:47:01 user nova-compute[75258]:     </nova:instance>
Nov 14 12:47:01 user nova-compute[75258]:   </metadata>
Nov 14 12:47:01 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:47:01 user nova-compute[75258]:     <system>
Nov 14 12:47:01 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:47:01 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:47:01 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:47:01 user nova-compute[75258]:       <entry name="serial">675b780c-92f9-41de-9457-ae035af15eeb</entry>
Nov 14 12:47:01 user nova-compute[75258]:       <entry name="uuid">675b780c-92f9-41de-9457-ae035af15eeb</entry>
Nov 14 12:47:01 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:47:01 user nova-compute[75258]:     </system>
Nov 14 12:47:01 user nova-compute[75258]:   </sysinfo>
Nov 14 12:47:01 user nova-compute[75258]:   <os>
Nov 14 12:47:01 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:47:01 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:47:01 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:47:01 user nova-compute[75258]:   </os>
Nov 14 12:47:01 user nova-compute[75258]:   <features>
Nov 14 12:47:01 user nova-compute[75258]:     <acpi/>
Nov 14 12:47:01 user nova-compute[75258]:     <apic/>
Nov 14 12:47:01 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:47:01 user nova-compute[75258]:   </features>
Nov 14 12:47:01 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:47:01 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:47:01 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:47:01 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:47:01 user nova-compute[75258]:   </clock>
Nov 14 12:47:01 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:47:01 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:47:01 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:47:01 user nova-compute[75258]:   </cpu>
Nov 14 12:47:01 user nova-compute[75258]:   <devices>
Nov 14 12:47:01 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:47:01 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:47:01 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk"/>
Nov 14 12:47:01 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:47:01 user nova-compute[75258]:     </disk>
Nov 14 12:47:01 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:47:01 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:47:01 user nova-compute[75258]:       <source dev="/dev/sdd"/>
Nov 14 12:47:01 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:47:01 user nova-compute[75258]:       <serial>6120e31a-3661-4d2d-a8cf-34fbd55386c8</serial>
Nov 14 12:47:01 user nova-compute[75258]:     </disk>
Nov 14 12:47:01 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:47:01 user nova-compute[75258]:       <mac address="fa:16:3e:42:82:58"/>
Nov 14 12:47:01 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:01 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:47:01 user nova-compute[75258]:       <target dev="tapf9fe5608-d5"/>
Nov 14 12:47:01 user nova-compute[75258]:     </interface>
Nov 14 12:47:01 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:47:01 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/console.log" append="off"/>
Nov 14 12:47:01 user nova-compute[75258]:     </serial>
Nov 14 12:47:01 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:47:01 user nova-compute[75258]:     <video>
Nov 14 12:47:01 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:01 user nova-compute[75258]:     </video>
Nov 14 12:47:01 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:47:01 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:47:01 user nova-compute[75258]:     </rng>
Nov 14 12:47:01 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:47:01 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:47:01 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:47:01 user nova-compute[75258]:     </memballoon>
Nov 14 12:47:01 user nova-compute[75258]:   </devices>
Nov 14 12:47:01 user nova-compute[75258]: </domain>
Nov 14 12:47:01 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:46:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG os_vif [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5093c991-1bb6-58ee-b068-3f8e246cbdf1', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf9fe5608-d5, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf9fe5608-d5, col_values=(('qos', UUID('9d591b1a-f318-45d5-acd2-63ebacbb4993')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf9fe5608-d5, col_values=(('external_ids', {'iface-id': 'f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:42:82:58', 'vm-uuid': '675b780c-92f9-41de-9457-ae035af15eeb'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:01 user nova-compute[75258]: INFO os_vif [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5')
Nov 14 12:47:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-fc199e07-4571-4a8b-a664-84e2b2321220 req-f66e54a5-814f-4582-a867-3152632ae366 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event volume-reimaged-dce3d526-3833-4dde-ab66-ffe18b83de13 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fc199e07-4571-4a8b-a664-84e2b2321220 req-f66e54a5-814f-4582-a867-3152632ae366 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fc199e07-4571-4a8b-a664-84e2b2321220 req-f66e54a5-814f-4582-a867-3152632ae366 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fc199e07-4571-4a8b-a664-84e2b2321220 req-f66e54a5-814f-4582-a867-3152632ae366 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-fc199e07-4571-4a8b-a664-84e2b2321220 req-f66e54a5-814f-4582-a867-3152632ae366 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Processing event volume-reimaged-dce3d526-3833-4dde-ab66-ffe18b83de13 {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10872}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance event wait completed in 12 seconds for volume-reimaged {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:02 user nova-compute[75258]: INFO nova.virt.block_device [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Booting with volume dce3d526-3833-4dde-ab66-ffe18b83de13 at /dev/vda
Nov 14 12:47:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG os_brick.utils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f786fcc-34de-47fc-8a0d-485757e71077]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1374d25b-72ce-4cf3-bdd0-d6ee8ec35c1b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7a0280-39b2-42f8-bae2-5bdaa5ec6b61]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5cb13f-24e2-448a-a719-fa54ae99c4fa]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-5051fda1-f29d-4e41-bbd7-ed8194a92704 req-3332bbeb-6bba-4015-8216-e654e2d97b6b service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5051fda1-f29d-4e41-bbd7-ed8194a92704 req-3332bbeb-6bba-4015-8216-e654e2d97b6b service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5051fda1-f29d-4e41-bbd7-ed8194a92704 req-3332bbeb-6bba-4015-8216-e654e2d97b6b service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5051fda1-f29d-4e41-bbd7-ed8194a92704 req-3332bbeb-6bba-4015-8216-e654e2d97b6b service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-5051fda1-f29d-4e41-bbd7-ed8194a92704 req-3332bbeb-6bba-4015-8216-e654e2d97b6b service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:03 user nova-compute[75258]: WARNING nova.compute.manager [req-5051fda1-f29d-4e41-bbd7-ed8194a92704 req-3332bbeb-6bba-4015-8216-e654e2d97b6b service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state resized and task_state resize_reverting.
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:47:03 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:47:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[601faf6c-2ae7-42dc-ac9b-5719c718cc9e]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG os_brick.utils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updating existing volume attachment record: d1b0d1ec-3118-42ec-aec7-b40fe58b3b92 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-b5ed60ca-7d40-44d1-b108-46ff0abab3cd req-8a1ae256-2149-4b63-91a6-34f6ed4879b3 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b5ed60ca-7d40-44d1-b108-46ff0abab3cd req-8a1ae256-2149-4b63-91a6-34f6ed4879b3 service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b5ed60ca-7d40-44d1-b108-46ff0abab3cd req-8a1ae256-2149-4b63-91a6-34f6ed4879b3 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b5ed60ca-7d40-44d1-b108-46ff0abab3cd req-8a1ae256-2149-4b63-91a6-34f6ed4879b3 service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-b5ed60ca-7d40-44d1-b108-46ff0abab3cd req-8a1ae256-2149-4b63-91a6-34f6ed4879b3 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:05 user nova-compute[75258]: WARNING nova.compute.manager [req-b5ed60ca-7d40-44d1-b108-46ff0abab3cd req-8a1ae256-2149-4b63-91a6-34f6ed4879b3 service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state resized and task_state resize_reverting.
Nov 14 12:47:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:47:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance running successfully.
Nov 14 12:47:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] finish_revert_migration finished successfully. {{(pid=75258) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Nov 14 12:47:05 user nova-compute[75258]: INFO nova.compute.manager [None req-0e438f73-7427-4916-bd16-51a2bc5f2e42 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance to original state: 'active'
Nov 14 12:47:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:47:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Creating image(s)
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Ensure instance console log exists: /opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Start _get_guest_xml network_info=[{"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f91e625f-a68e-4da4-aeb8-067f96d649a2', 'attached_at': '', 'detached_at': '', 'volume_id': 'dce3d526-3833-4dde-ab66-ffe18b83de13', 'serial': 'dce3d526-3833-4dde-ab66-ffe18b83de13'}, 'device_type': 'disk', 'attachment_id': 'd1b0d1ec-3118-42ec-aec7-b40fe58b3b92', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:47:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 12:47:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lazy-loading 'vcpu_model' on Instance uuid f91e625f-a68e-4da4-aeb8-067f96d649a2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:07 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eba0561-81c3-4b6e-befc-762bab05a914]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:47:07 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae794651-5d9c-4a44-821c-dc1fd5cfa280]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13] added
Nov 14 12:47:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f6c0ca5-5f5a-4b49-bf16-ff990b54b6f2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9923ab8-7638-4996-9202-022067127021]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUzKAPuo {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v bUzKAPuo" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5239829-233f-42c7-b780-e20c6223a01a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'bUzKAPuo'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5691be68-f4a8-47ca-b70d-abcb34a47146]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[720cf1f5-868d-438b-9a64-8df677717c00]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:07 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:07 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5065302d-5eb1-4a18-941f-4fdd1174c721]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]
Nov 14 12:47:07 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.
Nov 14 12:47:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05f2adf-8953-4653-ae5d-6d3d56c67457]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0575b6e-1109-4306-b67f-dc282b328757]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:07 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:07 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:08 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:08 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:08 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.264s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] HCTL ('33', '-', '-', 0) found on session 35 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45718193-0f60-4976-ae34-4375307e043a]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Searching for a device in session 35 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:47:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '23864303466343138', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864303466343138', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T12:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1833133202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1871672058',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ4EpalNHCuF/5YOtbe9vY1rDMtV3ANQJGWd7bNGBYdS3J6OMVDpSn+QMjc5MdIMPIZVzscHiy5W+ETizBVxNGIKcEQFM+4lsGLUuCbAPdQKTUdKxiCItircAwA8jYSwA==',key_name='tempest-keypair-872410949',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6554d9e28ce942b5933421198c41ff9a',ramdisk_id='',reservation_id='r-2p0el8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1507651178',owner_user_name='tempest-ServerActionsV293TestJSON-1507651178-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ab782add99f4231b2d7bbfd078edf62',uuid=f91e625f-a68e-4da4-aeb8-067f96d649a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converting VIF {"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:47:09 user nova-compute[75258]:   <uuid>f91e625f-a68e-4da4-aeb8-067f96d649a2</uuid>
Nov 14 12:47:09 user nova-compute[75258]:   <name>instance-00000017</name>
Nov 14 12:47:09 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:47:09 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:47:09 user nova-compute[75258]:   <metadata>
Nov 14 12:47:09 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:47:09 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:47:09 user nova-compute[75258]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1833133202</nova:name>
Nov 14 12:47:09 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:47:07</nova:creationTime>
Nov 14 12:47:09 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:47:09 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:47:09 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:47:09 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:47:09 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:47:09 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:47:09 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:47:09 user nova-compute[75258]:       <nova:owner>
Nov 14 12:47:09 user nova-compute[75258]:         <nova:user uuid="5ab782add99f4231b2d7bbfd078edf62">tempest-ServerActionsV293TestJSON-1507651178-project-member</nova:user>
Nov 14 12:47:09 user nova-compute[75258]:         <nova:project uuid="6554d9e28ce942b5933421198c41ff9a">tempest-ServerActionsV293TestJSON-1507651178</nova:project>
Nov 14 12:47:09 user nova-compute[75258]:       </nova:owner>
Nov 14 12:47:09 user nova-compute[75258]:       <nova:ports>
Nov 14 12:47:09 user nova-compute[75258]:         <nova:port uuid="7226e7fb-4e03-4182-a445-a30648b37027">
Nov 14 12:47:09 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 12:47:09 user nova-compute[75258]:         </nova:port>
Nov 14 12:47:09 user nova-compute[75258]:       </nova:ports>
Nov 14 12:47:09 user nova-compute[75258]:     </nova:instance>
Nov 14 12:47:09 user nova-compute[75258]:   </metadata>
Nov 14 12:47:09 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:47:09 user nova-compute[75258]:     <system>
Nov 14 12:47:09 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:47:09 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:47:09 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:47:09 user nova-compute[75258]:       <entry name="serial">f91e625f-a68e-4da4-aeb8-067f96d649a2</entry>
Nov 14 12:47:09 user nova-compute[75258]:       <entry name="uuid">f91e625f-a68e-4da4-aeb8-067f96d649a2</entry>
Nov 14 12:47:09 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:47:09 user nova-compute[75258]:     </system>
Nov 14 12:47:09 user nova-compute[75258]:   </sysinfo>
Nov 14 12:47:09 user nova-compute[75258]:   <os>
Nov 14 12:47:09 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:47:09 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:47:09 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:47:09 user nova-compute[75258]:   </os>
Nov 14 12:47:09 user nova-compute[75258]:   <features>
Nov 14 12:47:09 user nova-compute[75258]:     <acpi/>
Nov 14 12:47:09 user nova-compute[75258]:     <apic/>
Nov 14 12:47:09 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:47:09 user nova-compute[75258]:   </features>
Nov 14 12:47:09 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:47:09 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:47:09 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:47:09 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:47:09 user nova-compute[75258]:   </clock>
Nov 14 12:47:09 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:47:09 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:47:09 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:47:09 user nova-compute[75258]:   </cpu>
Nov 14 12:47:09 user nova-compute[75258]:   <devices>
Nov 14 12:47:09 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:47:09 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:47:09 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 12:47:09 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:47:09 user nova-compute[75258]:       <serial>dce3d526-3833-4dde-ab66-ffe18b83de13</serial>
Nov 14 12:47:09 user nova-compute[75258]:     </disk>
Nov 14 12:47:09 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:47:09 user nova-compute[75258]:       <mac address="fa:16:3e:e5:aa:15"/>
Nov 14 12:47:09 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:09 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:47:09 user nova-compute[75258]:       <target dev="tap7226e7fb-4e"/>
Nov 14 12:47:09 user nova-compute[75258]:     </interface>
Nov 14 12:47:09 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:47:09 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2/console.log" append="off"/>
Nov 14 12:47:09 user nova-compute[75258]:     </serial>
Nov 14 12:47:09 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:47:09 user nova-compute[75258]:     <video>
Nov 14 12:47:09 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:09 user nova-compute[75258]:     </video>
Nov 14 12:47:09 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:47:09 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:47:09 user nova-compute[75258]:     </rng>
Nov 14 12:47:09 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:47:09 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:47:09 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:47:09 user nova-compute[75258]:     </memballoon>
Nov 14 12:47:09 user nova-compute[75258]:   </devices>
Nov 14 12:47:09 user nova-compute[75258]: </domain>
Nov 14 12:47:09 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T12:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1833133202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1871672058',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ4EpalNHCuF/5YOtbe9vY1rDMtV3ANQJGWd7bNGBYdS3J6OMVDpSn+QMjc5MdIMPIZVzscHiy5W+ETizBVxNGIKcEQFM+4lsGLUuCbAPdQKTUdKxiCItircAwA8jYSwA==',key_name='tempest-keypair-872410949',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='6554d9e28ce942b5933421198c41ff9a',ramdisk_id='',reservation_id='r-2p0el8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1507651178',owner_user_name='tempest-ServerActionsV293TestJSON-1507651178-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:47:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ab782add99f4231b2d7bbfd078edf62',uuid=f91e625f-a68e-4da4-aeb8-067f96d649a2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converting VIF {"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG os_vif [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cb092288-97f6-5122-b675-6d06d894ad47', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7226e7fb-4e, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7226e7fb-4e, col_values=(('qos', UUID('92394b48-e949-4447-8367-2f3cac074ae3')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7226e7fb-4e, col_values=(('external_ids', {'iface-id': '7226e7fb-4e03-4182-a445-a30648b37027', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e5:aa:15', 'vm-uuid': 'f91e625f-a68e-4da4-aeb8-067f96d649a2'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:09 user nova-compute[75258]: INFO os_vif [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e')
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] No VIF found with MAC fa:16:3e:e5:aa:15, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-34b4bdc4-6dd5-4741-8bde-9a1cc73f53e9 req-8eb58b0a-9900-4150-b9ef-96c692c35f89 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-34b4bdc4-6dd5-4741-8bde-9a1cc73f53e9 req-8eb58b0a-9900-4150-b9ef-96c692c35f89 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-34b4bdc4-6dd5-4741-8bde-9a1cc73f53e9 req-8eb58b0a-9900-4150-b9ef-96c692c35f89 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-34b4bdc4-6dd5-4741-8bde-9a1cc73f53e9 req-8eb58b0a-9900-4150-b9ef-96c692c35f89 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-34b4bdc4-6dd5-4741-8bde-9a1cc73f53e9 req-8eb58b0a-9900-4150-b9ef-96c692c35f89 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No waiting events found dispatching network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:10 user nova-compute[75258]: WARNING nova.compute.manager [req-34b4bdc4-6dd5-4741-8bde-9a1cc73f53e9 req-8eb58b0a-9900-4150-b9ef-96c692c35f89 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received unexpected event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 12:47:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-422af2f6-c19d-45ca-a019-4494f9951b2c req-0b82b32f-df85-4809-a1f7-8a304c27cec5 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-422af2f6-c19d-45ca-a019-4494f9951b2c req-0b82b32f-df85-4809-a1f7-8a304c27cec5 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-422af2f6-c19d-45ca-a019-4494f9951b2c req-0b82b32f-df85-4809-a1f7-8a304c27cec5 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-422af2f6-c19d-45ca-a019-4494f9951b2c req-0b82b32f-df85-4809-a1f7-8a304c27cec5 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-422af2f6-c19d-45ca-a019-4494f9951b2c req-0b82b32f-df85-4809-a1f7-8a304c27cec5 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No waiting events found dispatching network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:12 user nova-compute[75258]: WARNING nova.compute.manager [req-422af2f6-c19d-45ca-a019-4494f9951b2c req-0b82b32f-df85-4809-a1f7-8a304c27cec5 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received unexpected event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:47:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance spawned successfully.
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG nova.objects.instance [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75258) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 12:47:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fc199e07-4571-4a8b-a664-84e2b2321220 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.073s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 12:47:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.208s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:47:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:47:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8002MB free_disk=25.10028839111328GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance f91e625f-a68e-4da4-aeb8-067f96d649a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance b498699b-b5f8-4428-bcde-b2893f600dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:47:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:47:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:47:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:47:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:47:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.381s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:47:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 12:47:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'flavor' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:24 user nova-compute[75258]: INFO nova.compute.manager [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Attaching volume 85fed65a-e240-4016-ada1-6b9e5e4044ea to /dev/vdb
Nov 14 12:47:24 user nova-compute[75258]: DEBUG os_brick.utils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd2c9d6-fd3e-4e3e-8f9a-d8acda5e3d6d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4c89ce4-9ec0-41b7-ae37-6e116d46a8f6]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[54b24331-adbb-459c-9115-9b1b91242a99]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f51c2fb1-d8cf-4c98-8245-5bc67b16730e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:47:24 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:47:24 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3094a21-ed2c-4172-a026-7b6ac7e0bf5b]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG os_brick.utils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:24 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating existing volume attachment record: 4982504b-088b-4691-968b-27726b98907b {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXEomthZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:29 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:29 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:29 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9746a4e-27fd-4ec8-b51f-f8bde4b2f01f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:47:29 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c315d-7d99-4279-bc81-fb3c3f55e25d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea] added
Nov 14 12:47:29 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71e0584-68bd-469f-9852-4c4f9749a888]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[859658b5-1e80-4615-b198-ea7615992e3c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXEomthZ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXEomthZ" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[df08b0b6-9c11-477a-b1d2-8b9bde9a0e8d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXEomthZ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[06a60792-75a2-400a-80a4-1f8fc7bbc158]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b6e1b9-a75b-43d3-aa79-df5711a2e86b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[774d0504-b3de-4808-8a3d-69086705e2e5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]
Nov 14 12:47:29 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.
Nov 14 12:47:29 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5ee873-325e-4580-ad44-0c44dc3a60a7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b728054-b454-41ef-8e68-61540cf3d83e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:29 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:29 user nova-compute[75258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:29 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] HCTL ('36', '-', '-', 0) found on session 36 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[23470d50-e185-4f87-9ec9-3e45a01adb02]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching for a device in session 36 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:47:29 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXEomthZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23864303830613761', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864303830613761', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG nova.objects.instance [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'flavor' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:47:30 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:47:30 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:47:30 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:47:30 user nova-compute[75258]:   <serial>85fed65a-e240-4016-ada1-6b9e5e4044ea</serial>
Nov 14 12:47:30 user nova-compute[75258]: </disk>
Nov 14 12:47:30 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No VIF found with MAC fa:16:3e:9a:66:9f, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:47:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-13235405-684a-4af2-8ae7-44eb738b2bb3 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.763s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing instance network info cache due to event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:47:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] Acquiring lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:47:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] Acquired lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:47:34 user nova-compute[75258]: DEBUG nova.network.neutron [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:47:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updated VIF entry in instance network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:47:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:47:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7b31997c-efa3-4d07-ac0c-e0214bc5c56b req-b5e9ccc4-d949-48f3-9787-714e1d8d1f37 service nova] Releasing lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:47:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing instance network info cache due to event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:47:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] Acquiring lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:47:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] Acquired lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:47:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:47:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updated VIF entry in instance network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:47:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:47:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c170e812-b9a1-45ce-ae48-42c879ad5785 req-1dd561e7-b2cc-4552-a32f-bef21d0dbdd8 service nova] Releasing lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:47:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:38 user nova-compute[75258]: INFO nova.compute.manager [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Rebooting instance
Nov 14 12:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquired lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Releasing lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-a0a1d86e-d32a-4c3c-a67d-7b0f7efdf1b1 req-38bb700c-88af-40f2-9790-83b53fb54495 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-unplugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a0a1d86e-d32a-4c3c-a67d-7b0f7efdf1b1 req-38bb700c-88af-40f2-9790-83b53fb54495 service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a0a1d86e-d32a-4c3c-a67d-7b0f7efdf1b1 req-38bb700c-88af-40f2-9790-83b53fb54495 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a0a1d86e-d32a-4c3c-a67d-7b0f7efdf1b1 req-38bb700c-88af-40f2-9790-83b53fb54495 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-a0a1d86e-d32a-4c3c-a67d-7b0f7efdf1b1 req-38bb700c-88af-40f2-9790-83b53fb54495 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-unplugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:39 user nova-compute[75258]: WARNING nova.compute.manager [req-a0a1d86e-d32a-4c3c-a67d-7b0f7efdf1b1 req-38bb700c-88af-40f2-9790-83b53fb54495 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received unexpected event network-vif-unplugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 12:47:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance destroyed successfully.
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.objects.instance [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'resources' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-531669879',display_name='tempest-TestMinimumBasicScenario-server-531669879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-531669879',id=24,image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO29bUilL5fawEGW6cAeHaeE8XFlTIQMLXwxAAuKiD5ZHgvRu1NB0NNWlX1KAbbqx9bYNwH4/3b7y1z39b8W3rj+AduXrWruaRuz/ztaJObf8rgea6b2vW0q+/RylnwMxA==',key_name='tempest-TestMinimumBasicScenario-1028670539',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-pxmq8c15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:47:40Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_vif [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9b2ef09-6c, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=a93c51a6-40b7-4909-aab2-33475eb6ea4b) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:40 user nova-compute[75258]: INFO os_vif [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c')
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXEomthZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:40 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c73c10d-c23c-4dd9-9761-6ca6adff924b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:47:40 user nova-compute[75258]: No targets found.
Nov 14 12:47:40 user nova-compute[75258]: iSNS:
Nov 14 12:47:40 user nova-compute[75258]: No targets found.
Nov 14 12:47:40 user nova-compute[75258]: STATIC:
Nov 14 12:47:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:47:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:47:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:47:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13
Nov 14 12:47:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:47:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:47:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:47:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:47:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:47:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:47:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:47:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:47:40 user nova-compute[75258]: FIRMWARE:
Nov 14 12:47:40 user nova-compute[75258]: No targets found.
Nov 14 12:47:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:47:40 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:47:40 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d77ffe2-9a81-473d-a944-dacaa21d510a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f458db5e-a9e9-4463-844d-eff53474593f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:40 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:40 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:40 user nova-compute[75258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:40 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:40 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:40 user nova-compute[75258]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b47a3880>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd8f454e-7c03-42e6-9402-173cba5a4f52]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f563cbc0-edcc-4ab6-a079-cc38fab8e8b9]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6db4c0-81a6-49f6-9212-6a988fd50182]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6572a456-1258-4f27-841e-ac4f03a3954a]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "4b10c730-fbaa-453c-816d-945762eb6622" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f56f76e-a9a2-4616-8474-4b77f292e4f6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fe54029-aa85-488e-ac12-d23e92820028]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]
Nov 14 12:47:40 user nova-compute[75258]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.
Nov 14 12:47:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:47:40 user nova-compute[75258]: INFO nova.compute.claims [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Claim successful on node user
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ff0befe-4270-4186-b736-fb4d24a60377]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== disconnect_volume: return (332ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Start _get_guest_xml network_info=[{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7e2e2167-92dd-4467-b8c8-8918acde57a6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '7e2e2167-92dd-4467-b8c8-8918acde57a6'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXEomthZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138', 'attached_at': '', 'detached_at': '', 'volume_id': '85fed65a-e240-4016-ada1-6b9e5e4044ea', 'serial': '85fed65a-e240-4016-ada1-6b9e5e4044ea'}, 'device_type': 'disk', 'attachment_id': '4982504b-088b-4691-968b-27726b98907b', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:47:40 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:47:40 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=7e2e2167-92dd-4467-b8c8-8918acde57a6,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.objects.instance [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'vcpu_model' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.objects.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Object Instance<a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138> lazy-loaded attributes: resources,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXEomthZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:40 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:40 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:40 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[066803fa-43f7-4c4f-9754-1108947dc694]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:47:40 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d014b94-ec97-4930-ae15-13a4957335c1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea] added
Nov 14 12:47:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a105a48d-8038-489f-9e4e-c4a3ce283e35]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2879f13-bb7d-470c-b063-cb45b8a47f33]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXEomthZ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v IXEomthZ" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4bbf904-637f-41bf-96b8-ab1b91990eab]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'IXEomthZ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[084cbc61-5572-4d12-8b7c-34405237a2a0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb7aed0-60ae-4732-9dc0-af3db54d82fa]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3ae58f-20f4-4849-a8b0-d3ec0d965322]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]
Nov 14 12:47:41 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.
Nov 14 12:47:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[74ea57dd-f4db-493e-b8df-b355a50737f0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30ca051-eb43-406e-896b-dd97e8a30e74]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:41 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] HCTL ('36', '-', '-', 0) found on session 37 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c91371a-ac0d-4330-ac10-948d641ff2cc]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching for a device in session 37 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXEomthZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:47:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.policy [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cef85161135e4a978dd763ae91809be9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c593ba588c7f442689362cda037f95f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:47:41 user nova-compute[75258]: INFO nova.virt.block_device [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Booting with volume-backed-image b293cbf1-70d3-49f7-8a42-771d90e2ec06 at /dev/vda
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-0757854a-75a1-4347-bac4-f17732cb75dc req-f59aeeb9-64ee-4c72-bbb8-bce8ac282767 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0757854a-75a1-4347-bac4-f17732cb75dc req-f59aeeb9-64ee-4c72-bbb8-bce8ac282767 service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0757854a-75a1-4347-bac4-f17732cb75dc req-f59aeeb9-64ee-4c72-bbb8-bce8ac282767 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0757854a-75a1-4347-bac4-f17732cb75dc req-f59aeeb9-64ee-4c72-bbb8-bce8ac282767 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-0757854a-75a1-4347-bac4-f17732cb75dc req-f59aeeb9-64ee-4c72-bbb8-bce8ac282767 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:41 user nova-compute[75258]: WARNING nova.compute.manager [req-0757854a-75a1-4347-bac4-f17732cb75dc req-f59aeeb9-64ee-4c72-bbb8-bce8ac282767 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received unexpected event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Successfully created port: 71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.327s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== connect_volume: return (1328ms) {'type': 'block', 'scsi_wwn': '23864303830613761', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23864303830613761', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-531669879',display_name='tempest-TestMinimumBasicScenario-server-531669879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-531669879',id=24,image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO29bUilL5fawEGW6cAeHaeE8XFlTIQMLXwxAAuKiD5ZHgvRu1NB0NNWlX1KAbbqx9bYNwH4/3b7y1z39b8W3rj+AduXrWruaRuz/ztaJObf8rgea6b2vW0q+/RylnwMxA==',key_name='tempest-TestMinimumBasicScenario-1028670539',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-pxmq8c15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:47:40Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'pci_devices' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.objects.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Object Instance<a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138> lazy-loaded attributes: resources,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:47:42 user nova-compute[75258]:   <uuid>a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138</uuid>
Nov 14 12:47:42 user nova-compute[75258]:   <name>instance-00000018</name>
Nov 14 12:47:42 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:47:42 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:47:42 user nova-compute[75258]:   <metadata>
Nov 14 12:47:42 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:47:42 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:47:42 user nova-compute[75258]:       <nova:name>tempest-TestMinimumBasicScenario-server-531669879</nova:name>
Nov 14 12:47:42 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:47:40</nova:creationTime>
Nov 14 12:47:42 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:47:42 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:47:42 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:47:42 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:47:42 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:47:42 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:47:42 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:47:42 user nova-compute[75258]:       <nova:owner>
Nov 14 12:47:42 user nova-compute[75258]:         <nova:user uuid="46ecec8040474acc8f5104e2e906d4e8">tempest-TestMinimumBasicScenario-30457951-project-member</nova:user>
Nov 14 12:47:42 user nova-compute[75258]:         <nova:project uuid="c4804d74a9a74c02b945b46f8c4e7183">tempest-TestMinimumBasicScenario-30457951</nova:project>
Nov 14 12:47:42 user nova-compute[75258]:       </nova:owner>
Nov 14 12:47:42 user nova-compute[75258]:       <nova:root type="image" uuid="7e2e2167-92dd-4467-b8c8-8918acde57a6"/>
Nov 14 12:47:42 user nova-compute[75258]:       <nova:ports>
Nov 14 12:47:42 user nova-compute[75258]:         <nova:port uuid="c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036">
Nov 14 12:47:42 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 12:47:42 user nova-compute[75258]:         </nova:port>
Nov 14 12:47:42 user nova-compute[75258]:       </nova:ports>
Nov 14 12:47:42 user nova-compute[75258]:     </nova:instance>
Nov 14 12:47:42 user nova-compute[75258]:   </metadata>
Nov 14 12:47:42 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:47:42 user nova-compute[75258]:     <system>
Nov 14 12:47:42 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:47:42 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:47:42 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:47:42 user nova-compute[75258]:       <entry name="serial">a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138</entry>
Nov 14 12:47:42 user nova-compute[75258]:       <entry name="uuid">a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138</entry>
Nov 14 12:47:42 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:47:42 user nova-compute[75258]:     </system>
Nov 14 12:47:42 user nova-compute[75258]:   </sysinfo>
Nov 14 12:47:42 user nova-compute[75258]:   <os>
Nov 14 12:47:42 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:47:42 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:47:42 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:47:42 user nova-compute[75258]:   </os>
Nov 14 12:47:42 user nova-compute[75258]:   <features>
Nov 14 12:47:42 user nova-compute[75258]:     <acpi/>
Nov 14 12:47:42 user nova-compute[75258]:     <apic/>
Nov 14 12:47:42 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:47:42 user nova-compute[75258]:   </features>
Nov 14 12:47:42 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:47:42 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:47:42 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:47:42 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:47:42 user nova-compute[75258]:   </clock>
Nov 14 12:47:42 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:47:42 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:47:42 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:47:42 user nova-compute[75258]:   </cpu>
Nov 14 12:47:42 user nova-compute[75258]:   <devices>
Nov 14 12:47:42 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:47:42 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:47:42 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk"/>
Nov 14 12:47:42 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:47:42 user nova-compute[75258]:     </disk>
Nov 14 12:47:42 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:47:42 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:47:42 user nova-compute[75258]:       <source dev="/dev/sde"/>
Nov 14 12:47:42 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:47:42 user nova-compute[75258]:       <serial>85fed65a-e240-4016-ada1-6b9e5e4044ea</serial>
Nov 14 12:47:42 user nova-compute[75258]:     </disk>
Nov 14 12:47:42 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:47:42 user nova-compute[75258]:       <mac address="fa:16:3e:9a:66:9f"/>
Nov 14 12:47:42 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:42 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:47:42 user nova-compute[75258]:       <target dev="tapc9b2ef09-6c"/>
Nov 14 12:47:42 user nova-compute[75258]:     </interface>
Nov 14 12:47:42 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:47:42 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/console.log" append="off"/>
Nov 14 12:47:42 user nova-compute[75258]:     </serial>
Nov 14 12:47:42 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:47:42 user nova-compute[75258]:     <video>
Nov 14 12:47:42 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:42 user nova-compute[75258]:     </video>
Nov 14 12:47:42 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:47:42 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:47:42 user nova-compute[75258]:     </rng>
Nov 14 12:47:42 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:47:42 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:47:42 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:47:42 user nova-compute[75258]:     </memballoon>
Nov 14 12:47:42 user nova-compute[75258]:   </devices>
Nov 14 12:47:42 user nova-compute[75258]: </domain>
Nov 14 12:47:42 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'trusted_certs' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Successfully updated port: 71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.objects.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Object Instance<a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-changed-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Refreshing instance network info cache due to event network-changed-71b3751d-f821-435d-b448-6fc50c8eb1a1. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] Acquiring lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] Acquired lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.neutron [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Refreshing network info cache for port 71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.neutron [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.neutron [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a1225928-e194-4abd-8caa-a13085b371e6 req-0cf164ef-b350-46fb-a17e-cfbfe078aaf7 service nova] Releasing lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Cannot resize image /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'migration_context' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.objects.base [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Object Instance<a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138> lazy-loaded attributes: resources,vcpu_model,pci_devices,trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-531669879',display_name='tempest-TestMinimumBasicScenario-server-531669879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-531669879',id=24,image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO29bUilL5fawEGW6cAeHaeE8XFlTIQMLXwxAAuKiD5ZHgvRu1NB0NNWlX1KAbbqx9bYNwH4/3b7y1z39b8W3rj+AduXrWruaRuz/ztaJObf8rgea6b2vW0q+/RylnwMxA==',key_name='tempest-TestMinimumBasicScenario-1028670539',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-pxmq8c15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:47:40Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:42 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG os_vif [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '33771cbc-afff-53b9-a8d1-63c7973ea252', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc9b2ef09-6c, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc9b2ef09-6c, col_values=(('qos', UUID('19758ab4-9f6d-4ffc-8f59-ca2eb1fc0aeb')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc9b2ef09-6c, col_values=(('external_ids', {'iface-id': 'c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9a:66:9f', 'vm-uuid': 'a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:43 user nova-compute[75258]: INFO os_vif [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c')
Nov 14 12:47:43 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Updating instance_info_cache with network_info: [{"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:47:43 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance network_info: |[{"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-95894470-54af-4f07-80bd-66b71bf9be47 req-6f4bd2fb-79eb-4bf7-acc5-edea69d2cc32 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-95894470-54af-4f07-80bd-66b71bf9be47 req-6f4bd2fb-79eb-4bf7-acc5-edea69d2cc32 service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-95894470-54af-4f07-80bd-66b71bf9be47 req-6f4bd2fb-79eb-4bf7-acc5-edea69d2cc32 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-95894470-54af-4f07-80bd-66b71bf9be47 req-6f4bd2fb-79eb-4bf7-acc5-edea69d2cc32 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-95894470-54af-4f07-80bd-66b71bf9be47 req-6f4bd2fb-79eb-4bf7-acc5-edea69d2cc32 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:44 user nova-compute[75258]: WARNING nova.compute.manager [req-95894470-54af-4f07-80bd-66b71bf9be47 req-6f4bd2fb-79eb-4bf7-acc5-edea69d2cc32 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received unexpected event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with vm_state active and task_state reboot_started_hard.
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:47:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance rebooted successfully.
Nov 14 12:47:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-613b0c51-c36a-4d2a-8127-19d9860a9525 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.529s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-0266687f-bc17-4201-ac52-a4acbfb38b71 req-4350251d-6b26-4d32-8624-5b2271fc7e30 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0266687f-bc17-4201-ac52-a4acbfb38b71 req-4350251d-6b26-4d32-8624-5b2271fc7e30 service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0266687f-bc17-4201-ac52-a4acbfb38b71 req-4350251d-6b26-4d32-8624-5b2271fc7e30 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0266687f-bc17-4201-ac52-a4acbfb38b71 req-4350251d-6b26-4d32-8624-5b2271fc7e30 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-0266687f-bc17-4201-ac52-a4acbfb38b71 req-4350251d-6b26-4d32-8624-5b2271fc7e30 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:46 user nova-compute[75258]: WARNING nova.compute.manager [req-0266687f-bc17-4201-ac52-a4acbfb38b71 req-4350251d-6b26-4d32-8624-5b2271fc7e30 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received unexpected event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with vm_state active and task_state None.
Nov 14 12:47:46 user nova-compute[75258]: DEBUG os_brick.utils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[75922cef-9206-4818-95e1-07a8087533c9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dd549c-b8ae-4b02-8b1e-c7f467b05ae3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0470d55e-cb79-4689-90f8-ae7d6e94f3df]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3384d90e-4cf8-4f32-b805-c7b36c0e15b4]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:47:47 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:47:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5df5d864-099b-4353-b32d-8d3e2c417eaf]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG os_brick.utils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:47 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Updating existing volume attachment record: cfb1a14e-5652-470b-a91f-ba167327efcb {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:47:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:47:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Creating image(s)
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Ensure instance console log exists: /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Start _get_guest_xml network_info=[{"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APevbNsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4b10c730-fbaa-453c-816d-945762eb6622', 'attached_at': '', 'detached_at': '', 'volume_id': '4f963b11-7050-4946-873c-fb4638229fac', 'serial': '4f963b11-7050-4946-873c-fb4638229fac'}, 'device_type': 'disk', 'attachment_id': 'cfb1a14e-5652-470b-a91f-ba167327efcb', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:47:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:47:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APevbNsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:47:51 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:51 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:47:51 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2237de03-d45f-4d42-adca-d740a138ccb2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:47:51 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[805880df-5877-4753-857b-f20a0363ceae]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac] added
Nov 14 12:47:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[74882e05-56e0-47d8-b2e1-c42e4efb3c31]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec64f080-30c8-4886-898f-777eaa78ce5e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APevbNsJ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APevbNsJ" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b49f5e1-c258-4a41-ba39-55b9a567de18]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APevbNsJ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd953bf5-2c58-4ad3-bc52-d78e7b7799f6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[326459d9-17a9-4f9e-9b9c-75d10ff35ca8]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f75f72f-0d5c-4259-b856-405f45f648b7]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260]
Nov 14 12:47:51 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260] successful.
Nov 14 12:47:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[22db81ad-8300-475a-8c98-c543838aad64]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4dfb3c-0ffc-4f45-9eca-e2ef5df6baff]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:47:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:47:51 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:47:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] HCTL ('37', '-', '-', 0) found on session 38 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:47:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:47:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:47:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0c0dbef-feeb-4645-9518-a275987c217b]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:47:52 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching for a device in session 38 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:47:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APevbNsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '26438316636663938', 'path': '/dev/sdf'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438316636663938', 'path': '/dev/sdf'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-623595415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-623595415',id=27,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-4q0pq0nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:47:41Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=4b10c730-fbaa-453c-816d-945762eb6622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:47:53 user nova-compute[75258]:   <uuid>4b10c730-fbaa-453c-816d-945762eb6622</uuid>
Nov 14 12:47:53 user nova-compute[75258]:   <name>instance-0000001b</name>
Nov 14 12:47:53 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:47:53 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:47:53 user nova-compute[75258]:   <metadata>
Nov 14 12:47:53 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:47:53 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:47:53 user nova-compute[75258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-623595415</nova:name>
Nov 14 12:47:53 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:47:51</nova:creationTime>
Nov 14 12:47:53 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:47:53 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:47:53 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:47:53 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:47:53 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:47:53 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:47:53 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:47:53 user nova-compute[75258]:       <nova:owner>
Nov 14 12:47:53 user nova-compute[75258]:         <nova:user uuid="cef85161135e4a978dd763ae91809be9">tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member</nova:user>
Nov 14 12:47:53 user nova-compute[75258]:         <nova:project uuid="c593ba588c7f442689362cda037f95f8">tempest-ServerBootFromVolumeStableRescueTest-1735756414</nova:project>
Nov 14 12:47:53 user nova-compute[75258]:       </nova:owner>
Nov 14 12:47:53 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:47:53 user nova-compute[75258]:       <nova:ports>
Nov 14 12:47:53 user nova-compute[75258]:         <nova:port uuid="71b3751d-f821-435d-b448-6fc50c8eb1a1">
Nov 14 12:47:53 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 12:47:53 user nova-compute[75258]:         </nova:port>
Nov 14 12:47:53 user nova-compute[75258]:       </nova:ports>
Nov 14 12:47:53 user nova-compute[75258]:     </nova:instance>
Nov 14 12:47:53 user nova-compute[75258]:   </metadata>
Nov 14 12:47:53 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:47:53 user nova-compute[75258]:     <system>
Nov 14 12:47:53 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:47:53 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:47:53 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:47:53 user nova-compute[75258]:       <entry name="serial">4b10c730-fbaa-453c-816d-945762eb6622</entry>
Nov 14 12:47:53 user nova-compute[75258]:       <entry name="uuid">4b10c730-fbaa-453c-816d-945762eb6622</entry>
Nov 14 12:47:53 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:47:53 user nova-compute[75258]:     </system>
Nov 14 12:47:53 user nova-compute[75258]:   </sysinfo>
Nov 14 12:47:53 user nova-compute[75258]:   <os>
Nov 14 12:47:53 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:47:53 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:47:53 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:47:53 user nova-compute[75258]:   </os>
Nov 14 12:47:53 user nova-compute[75258]:   <features>
Nov 14 12:47:53 user nova-compute[75258]:     <acpi/>
Nov 14 12:47:53 user nova-compute[75258]:     <apic/>
Nov 14 12:47:53 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:47:53 user nova-compute[75258]:   </features>
Nov 14 12:47:53 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:47:53 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:47:53 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:47:53 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:47:53 user nova-compute[75258]:   </clock>
Nov 14 12:47:53 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:47:53 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:47:53 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:47:53 user nova-compute[75258]:   </cpu>
Nov 14 12:47:53 user nova-compute[75258]:   <devices>
Nov 14 12:47:53 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:47:53 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:47:53 user nova-compute[75258]:       <source dev="/dev/sdf"/>
Nov 14 12:47:53 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:47:53 user nova-compute[75258]:       <serial>4f963b11-7050-4946-873c-fb4638229fac</serial>
Nov 14 12:47:53 user nova-compute[75258]:     </disk>
Nov 14 12:47:53 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:47:53 user nova-compute[75258]:       <mac address="fa:16:3e:4c:0e:eb"/>
Nov 14 12:47:53 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:53 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:47:53 user nova-compute[75258]:       <target dev="tap71b3751d-f8"/>
Nov 14 12:47:53 user nova-compute[75258]:     </interface>
Nov 14 12:47:53 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:47:53 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/console.log" append="off"/>
Nov 14 12:47:53 user nova-compute[75258]:     </serial>
Nov 14 12:47:53 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:47:53 user nova-compute[75258]:     <video>
Nov 14 12:47:53 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:47:53 user nova-compute[75258]:     </video>
Nov 14 12:47:53 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:47:53 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:47:53 user nova-compute[75258]:     </rng>
Nov 14 12:47:53 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:47:53 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:47:53 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:47:53 user nova-compute[75258]:     </memballoon>
Nov 14 12:47:53 user nova-compute[75258]:   </devices>
Nov 14 12:47:53 user nova-compute[75258]: </domain>
Nov 14 12:47:53 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-623595415',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-623595415',id=27,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-4q0pq0nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:47:41Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=4b10c730-fbaa-453c-816d-945762eb6622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG os_vif [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7629749c-9356-5e15-9c1c-288adc09551d', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap71b3751d-f8, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap71b3751d-f8, col_values=(('qos', UUID('e2b69fc8-9c5a-4d89-abe8-fe7c41af9988')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap71b3751d-f8, col_values=(('external_ids', {'iface-id': '71b3751d-f821-435d-b448-6fc50c8eb1a1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:0e:eb', 'vm-uuid': '4b10c730-fbaa-453c-816d-945762eb6622'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:53 user nova-compute[75258]: INFO os_vif [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8')
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:47:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No VIF found with MAC fa:16:3e:4c:0e:eb, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-15e6c6b5-a886-41a8-8847-8091d1595c9d req-811bc41b-458f-4457-b31d-97debae6acf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-15e6c6b5-a886-41a8-8847-8091d1595c9d req-811bc41b-458f-4457-b31d-97debae6acf7 service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-15e6c6b5-a886-41a8-8847-8091d1595c9d req-811bc41b-458f-4457-b31d-97debae6acf7 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.005s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-15e6c6b5-a886-41a8-8847-8091d1595c9d req-811bc41b-458f-4457-b31d-97debae6acf7 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-15e6c6b5-a886-41a8-8847-8091d1595c9d req-811bc41b-458f-4457-b31d-97debae6acf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:54 user nova-compute[75258]: WARNING nova.compute.manager [req-15e6c6b5-a886-41a8-8847-8091d1595c9d req-811bc41b-458f-4457-b31d-97debae6acf7 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state building and task_state spawning.
Nov 14 12:47:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:47:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance spawned successfully.
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:47:56 user nova-compute[75258]: INFO nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Took 4.83 seconds to spawn the instance on the hypervisor.
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:47:56 user nova-compute[75258]: INFO nova.compute.manager [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Took 15.81 seconds to build instance.
Nov 14 12:47:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3f72b384-051d-4457-9ba2-83100b307df4 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "4b10c730-fbaa-453c-816d-945762eb6622" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.904s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-d5551218-c0c1-4b06-bb0a-1dc9a716d133 req-2c565f82-49c9-45b9-a3ec-7e6be14cbf2d service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d5551218-c0c1-4b06-bb0a-1dc9a716d133 req-2c565f82-49c9-45b9-a3ec-7e6be14cbf2d service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d5551218-c0c1-4b06-bb0a-1dc9a716d133 req-2c565f82-49c9-45b9-a3ec-7e6be14cbf2d service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d5551218-c0c1-4b06-bb0a-1dc9a716d133 req-2c565f82-49c9-45b9-a3ec-7e6be14cbf2d service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:47:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-d5551218-c0c1-4b06-bb0a-1dc9a716d133 req-2c565f82-49c9-45b9-a3ec-7e6be14cbf2d service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:47:56 user nova-compute[75258]: WARNING nova.compute.manager [req-d5551218-c0c1-4b06-bb0a-1dc9a716d133 req-2c565f82-49c9-45b9-a3ec-7e6be14cbf2d service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state active and task_state None.
Nov 14 12:47:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:47:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-changed-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG nova.compute.manager [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Refreshing instance network info cache due to event network-changed-96918577-6f0a-4f2d-b038-8b1245a6a931. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] Acquiring lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] Acquired lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Refreshing network info cache for port 96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updated VIF entry in instance network info cache for port 96918577-6f0a-4f2d-b038-8b1245a6a931. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updating instance_info_cache with network_info: [{"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30465166-c889-415e-8a63-7035ba7a6309 req-f03e1726-dd3f-4604-8aa0-e5774e07892d service nova] Releasing lock "refresh_cache-7cadfc3a-d7a8-433e-b35e-c4021d78c529" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'flavor' on Instance uuid 7cadfc3a-d7a8-433e-b35e-c4021d78c529 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:48:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:02 user nova-compute[75258]: INFO nova.compute.manager [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Attaching volume 674c98a5-cddf-449c-b06f-3f143ef64e3c to /dev/vdb
Nov 14 12:48:02 user nova-compute[75258]: DEBUG os_brick.utils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3aa3326-1079-4c89-a7c4-2dc2fec91268]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f6361d1-fa92-45a3-9f1b-f414f8fb4304]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5ca0c7-12da-4663-885f-b78edf450328]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a09be7e-bd75-47f3-988d-f308ca927310]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:02 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:48:02 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be21fca-82df-4c92-88e6-6493a8b20ac7]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG os_brick.utils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:02 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updating existing volume attachment record: b6c9ea42-e32c-4215-9600-3184a992703c {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:48:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:06 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:06 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:06 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c5b890-9719-472b-8c4d-bddc1edc467a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:48:06 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[148bebc3-f653-4794-948d-0eea1db05c1a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c] added
Nov 14 12:48:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[830ef88c-bf7f-41c7-9d2f-fcaa56a39a27]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01fc24d9-a8f4-466d-a142-7eaa66b57994]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmerEPKZ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmerEPKZ" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cca6255-07e0-476a-be19-97dae0d61c19]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmerEPKZ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[30aed68b-0f3d-46f0-868b-8b9426bbae11]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c75a1ac4-2448-49a3-8f6e-645f6b57b8d5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f38d5b6f-87c0-4c2e-9212-8a072d31dd55]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]
Nov 14 12:48:06 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.
Nov 14 12:48:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c43001-8647-449f-a2a5-b5560e879d4f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24ee5a0d-0749-4852-be4e-dbe7e0a805d1]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:06 user nova-compute[75258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] HCTL ('38', '-', '-', 0) found on session 39 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5028fb6-3b5e-4df0-822c-55452c8ff587]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching for a device in session 39 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:48:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:48:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== connect_volume: return (1350ms) {'type': 'block', 'scsi_wwn': '23535323065313863', 'path': '/dev/sdg'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535323065313863', 'path': '/dev/sdg'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:48:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'flavor' on Instance uuid 7cadfc3a-d7a8-433e-b35e-c4021d78c529 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:48:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:48:07 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:48:07 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:48:07 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:48:07 user nova-compute[75258]:   <serial>674c98a5-cddf-449c-b06f-3f143ef64e3c</serial>
Nov 14 12:48:07 user nova-compute[75258]: </disk>
Nov 14 12:48:07 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:48:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:48:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:48:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No VIF found with MAC fa:16:3e:13:56:7b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:48:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0a242133-29f1-49b7-b6ae-e7f5a97a4ef2 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.406s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:10 user nova-compute[75258]: INFO nova.compute.manager [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Rebuilding instance
Nov 14 12:48:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-477e8dd5-87fc-4740-87da-d2986c03d458 req-566f12be-98b5-416c-9eea-be9a8a90705d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-unplugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-477e8dd5-87fc-4740-87da-d2986c03d458 req-566f12be-98b5-416c-9eea-be9a8a90705d service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-477e8dd5-87fc-4740-87da-d2986c03d458 req-566f12be-98b5-416c-9eea-be9a8a90705d service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-477e8dd5-87fc-4740-87da-d2986c03d458 req-566f12be-98b5-416c-9eea-be9a8a90705d service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-477e8dd5-87fc-4740-87da-d2986c03d458 req-566f12be-98b5-416c-9eea-be9a8a90705d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-unplugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:48:10 user nova-compute[75258]: WARNING nova.compute.manager [req-477e8dd5-87fc-4740-87da-d2986c03d458 req-566f12be-98b5-416c-9eea-be9a8a90705d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received unexpected event network-vif-unplugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with vm_state active and task_state rebuilding.
Nov 14 12:48:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance destroyed successfully.
Nov 14 12:48:11 user nova-compute[75258]: INFO nova.compute.manager [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Detaching volume 674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:48:11 user nova-compute[75258]: INFO nova.virt.block_device [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Attempting to driver detach volume 674c98a5-cddf-449c-b06f-3f143ef64e3c from mountpoint /dev/vdb
Nov 14 12:48:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Attempting to detach device vdb from instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:48:11 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:48:11 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:48:11 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:48:11 user nova-compute[75258]:   <serial>674c98a5-cddf-449c-b06f-3f143ef64e3c</serial>
Nov 14 12:48:11 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:48:11 user nova-compute[75258]: </disk>
Nov 14 12:48:11 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:48:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully detached device vdb from instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 from the persistent domain config.
Nov 14 12:48:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:11 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[806ad6a2-fb05-4c2b-ba72-60dafe53dabb]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:48:11 user nova-compute[75258]: No targets found.
Nov 14 12:48:11 user nova-compute[75258]: iSNS:
Nov 14 12:48:11 user nova-compute[75258]: No targets found.
Nov 14 12:48:11 user nova-compute[75258]: STATIC:
Nov 14 12:48:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:48:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:48:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13
Nov 14 12:48:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:48:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:48:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:11 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:48:11 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:11 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:11 user nova-compute[75258]: FIRMWARE:
Nov 14 12:48:11 user nova-compute[75258]: No targets found.
Nov 14 12:48:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:48:11 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:48:11 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e694418-ea56-46c8-b911-5026d8213e2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a016bf43-9e14-4075-84b5-191762f2d913]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:11 user nova-compute[75258]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b439ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c'): ({'sdg'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Removing single pathed devices sdg {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf7a4f4-afd5-4e4c-b9da-acbb72d43230]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c8792e9-33bf-41a4-8e37-d63a7d659b27]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flushing IO for device /dev/sdg {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfddd90c-2ad1-4e08-9a95-81196d19611f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.039s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[751617b6-f32d-45f3-8b0a-cbd161d41ee2]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0864f5d1-3e86-4f22-96d6-1599e0c3ff59]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15b66ef-a88e-4a5a-834c-e43db57c3a15]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]
Nov 14 12:48:11 user nova-compute[75258]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.
Nov 14 12:48:11 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db82f67c-0ee3-4bec-99e5-00e7139a57a7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== disconnect_volume: return (324ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance destroyed successfully.
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-715727060',display_name='tempest-ServerActionsTestOtherA-server-839366482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-715727060',id=25,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6nOBmZS16HrsAcRDVYl1N9VVZlKCYS7vsVvKoBzd7OKlnMV1+Jxm/buZP9fLrIbNZp7VauNlpAeDzgdQNI3huVDLpo9eCIQ/k9KMnvgkmlp4agFaOxDXYwrXHYbT2qbQ==',key_name='tempest-keypair-149773274',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-buwy3nts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:48:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=7cadfc3a-d7a8-433e-b35e-c4021d78c529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_vif [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-99fc943e-d6fc-4df6-89f0-cac75f584948 req-27fde469-f987-4b8f-9da2-17281ac61313 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-99fc943e-d6fc-4df6-89f0-cac75f584948 req-27fde469-f987-4b8f-9da2-17281ac61313 service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-99fc943e-d6fc-4df6-89f0-cac75f584948 req-27fde469-f987-4b8f-9da2-17281ac61313 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-99fc943e-d6fc-4df6-89f0-cac75f584948 req-27fde469-f987-4b8f-9da2-17281ac61313 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-99fc943e-d6fc-4df6-89f0-cac75f584948 req-27fde469-f987-4b8f-9da2-17281ac61313 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:48:12 user nova-compute[75258]: WARNING nova.compute.manager [req-99fc943e-d6fc-4df6-89f0-cac75f584948 req-27fde469-f987-4b8f-9da2-17281ac61313 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received unexpected event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with vm_state active and task_state rebuilding.
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96918577-6f, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=78a592f3-4106-4ced-bddc-e0eb33541776) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:12 user nova-compute[75258]: INFO os_vif [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f')
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:12 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ac8d54-8179-4d35-a0a9-64b7caea2d6e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:48:12 user nova-compute[75258]: No targets found.
Nov 14 12:48:12 user nova-compute[75258]: iSNS:
Nov 14 12:48:12 user nova-compute[75258]: No targets found.
Nov 14 12:48:12 user nova-compute[75258]: STATIC:
Nov 14 12:48:12 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:48:12 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:12 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:12 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:48:12 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:12 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:12 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13
Nov 14 12:48:12 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:12 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:12 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:48:12 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:12 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:12 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:48:12 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:12 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:12 user nova-compute[75258]: FIRMWARE:
Nov 14 12:48:12 user nova-compute[75258]: No targets found.
Nov 14 12:48:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:48:12 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:48:12 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[44484d93-1ad9-4e75-a77b-7d20581940b6]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[39915f2a-8e15-4d80-a827-9b588ecadf90]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:12 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b464eb90>, {}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Disconnecting from: [] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.073s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== disconnect_volume: return (76ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:48:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Deleting instance files /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529_del
Nov 14 12:48:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Deletion of /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529_del complete
Nov 14 12:48:12 user nova-compute[75258]: INFO nova.virt.block_device [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Booting with volume 674c98a5-cddf-449c-b06f-3f143ef64e3c at /dev/vdb
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.utils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e9909e1-4607-4d63-b4de-dc1ba2ae2f0c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce233102-a037-4256-904d-0e692047b38a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2481524-cc18-4ce6-9302-4f753472ed0e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[83705d31-8bdf-47ab-9238-158046af0a65]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:12 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:48:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f9151e-c06d-41c7-b5ca-68c0640296e1]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG os_brick.utils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:12 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updating existing volume attachment record: 0e37f1a4-e4ce-48b5-8b90-04b4c5fb593f {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:48:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:48:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:48:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:48:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:48:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:48:17 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Creating image(s)
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk 1073741824" returned: 0 in 0.047s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Cannot resize image /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Ensure instance console log exists: /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Start _get_guest_xml network_info=[{"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '7cadfc3a-d7a8-433e-b35e-c4021d78c529', 'attached_at': '', 'detached_at': '', 'volume_id': '674c98a5-cddf-449c-b06f-3f143ef64e3c', 'serial': '674c98a5-cddf-449c-b06f-3f143ef64e3c'}, 'device_type': 'disk', 'attachment_id': '0e37f1a4-e4ce-48b5-8b90-04b4c5fb593f', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:48:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 12:48:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7cadfc3a-d7a8-433e-b35e-c4021d78c529 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:18 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:18 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:18 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec5165a0-2753-48f2-a715-47b9c1a51e42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:48:18 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[84ecb6b3-3f76-4cd9-b592-a3540011e4eb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c] added
Nov 14 12:48:18 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[19db69ec-39c7-47c0-93e5-edf442abe50d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[829ffbcf-6de0-4f78-9601-63a706fc6f0a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmerEPKZ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmerEPKZ" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[29e90137-09a3-4f77-83b3-01bc7d4495e6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmerEPKZ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c46a279-e74b-4bb4-84db-1724d2b560d1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3cd7ec6-e8ae-40f1-8ff9-f1ca48276b1a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51c14874-5bcb-4ddc-877a-b6b628883496]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]
Nov 14 12:48:19 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.
Nov 14 12:48:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b1c26e7-4789-41ae-91b7-6c972bca4c8e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8527c659-0b9b-4f37-ac3c-28ba48614824]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:19 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.346s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] HCTL ('38', '-', '-', 0) found on session 40 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[09e3a16d-7490-48ec-be10-cdd8669c52d1]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching for a device in session 40 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23535323065313863', 'path': '/dev/sdg'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23535323065313863', 'path': '/dev/sdg'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:48:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:48:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7864MB free_disk=25.122173309326172GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T12:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-715727060',display_name='tempest-ServerActionsTestOtherA-server-839366482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-715727060',id=25,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6nOBmZS16HrsAcRDVYl1N9VVZlKCYS7vsVvKoBzd7OKlnMV1+Jxm/buZP9fLrIbNZp7VauNlpAeDzgdQNI3huVDLpo9eCIQ/k9KMnvgkmlp4agFaOxDXYwrXHYbT2qbQ==',key_name='tempest-keypair-149773274',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-buwy3nts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=7cadfc3a-d7a8-433e-b35e-c4021d78c529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:48:20 user nova-compute[75258]:   <uuid>7cadfc3a-d7a8-433e-b35e-c4021d78c529</uuid>
Nov 14 12:48:20 user nova-compute[75258]:   <name>instance-00000019</name>
Nov 14 12:48:20 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:48:20 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:48:20 user nova-compute[75258]:   <metadata>
Nov 14 12:48:20 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:48:20 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:48:20 user nova-compute[75258]:       <nova:name>tempest-ServerActionsTestOtherA-server-839366482</nova:name>
Nov 14 12:48:20 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:48:18</nova:creationTime>
Nov 14 12:48:20 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:48:20 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:48:20 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:48:20 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:48:20 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:48:20 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:48:20 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:48:20 user nova-compute[75258]:       <nova:owner>
Nov 14 12:48:20 user nova-compute[75258]:         <nova:user uuid="974df2b5a20f414eadb9e84383523e4f">tempest-ServerActionsTestOtherA-1553354563-project-member</nova:user>
Nov 14 12:48:20 user nova-compute[75258]:         <nova:project uuid="a6dc8f5ff4bf4a4788a2f7ec14b844f5">tempest-ServerActionsTestOtherA-1553354563</nova:project>
Nov 14 12:48:20 user nova-compute[75258]:       </nova:owner>
Nov 14 12:48:20 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:48:20 user nova-compute[75258]:       <nova:ports>
Nov 14 12:48:20 user nova-compute[75258]:         <nova:port uuid="96918577-6f0a-4f2d-b038-8b1245a6a931">
Nov 14 12:48:20 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 12:48:20 user nova-compute[75258]:         </nova:port>
Nov 14 12:48:20 user nova-compute[75258]:       </nova:ports>
Nov 14 12:48:20 user nova-compute[75258]:     </nova:instance>
Nov 14 12:48:20 user nova-compute[75258]:   </metadata>
Nov 14 12:48:20 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:48:20 user nova-compute[75258]:     <system>
Nov 14 12:48:20 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:48:20 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:48:20 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:48:20 user nova-compute[75258]:       <entry name="serial">7cadfc3a-d7a8-433e-b35e-c4021d78c529</entry>
Nov 14 12:48:20 user nova-compute[75258]:       <entry name="uuid">7cadfc3a-d7a8-433e-b35e-c4021d78c529</entry>
Nov 14 12:48:20 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:48:20 user nova-compute[75258]:     </system>
Nov 14 12:48:20 user nova-compute[75258]:   </sysinfo>
Nov 14 12:48:20 user nova-compute[75258]:   <os>
Nov 14 12:48:20 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:48:20 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:48:20 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:48:20 user nova-compute[75258]:   </os>
Nov 14 12:48:20 user nova-compute[75258]:   <features>
Nov 14 12:48:20 user nova-compute[75258]:     <acpi/>
Nov 14 12:48:20 user nova-compute[75258]:     <apic/>
Nov 14 12:48:20 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:48:20 user nova-compute[75258]:   </features>
Nov 14 12:48:20 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:48:20 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:48:20 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:48:20 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:48:20 user nova-compute[75258]:   </clock>
Nov 14 12:48:20 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:48:20 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:48:20 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:48:20 user nova-compute[75258]:   </cpu>
Nov 14 12:48:20 user nova-compute[75258]:   <devices>
Nov 14 12:48:20 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:48:20 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:48:20 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk"/>
Nov 14 12:48:20 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:48:20 user nova-compute[75258]:     </disk>
Nov 14 12:48:20 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:48:20 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:48:20 user nova-compute[75258]:       <source dev="/dev/sdg"/>
Nov 14 12:48:20 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:48:20 user nova-compute[75258]:       <serial>674c98a5-cddf-449c-b06f-3f143ef64e3c</serial>
Nov 14 12:48:20 user nova-compute[75258]:     </disk>
Nov 14 12:48:20 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:48:20 user nova-compute[75258]:       <mac address="fa:16:3e:13:56:7b"/>
Nov 14 12:48:20 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:48:20 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:48:20 user nova-compute[75258]:       <target dev="tap96918577-6f"/>
Nov 14 12:48:20 user nova-compute[75258]:     </interface>
Nov 14 12:48:20 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:48:20 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/console.log" append="off"/>
Nov 14 12:48:20 user nova-compute[75258]:     </serial>
Nov 14 12:48:20 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:48:20 user nova-compute[75258]:     <video>
Nov 14 12:48:20 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:48:20 user nova-compute[75258]:     </video>
Nov 14 12:48:20 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:48:20 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:48:20 user nova-compute[75258]:     </rng>
Nov 14 12:48:20 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:48:20 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:48:20 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:48:20 user nova-compute[75258]:     </memballoon>
Nov 14 12:48:20 user nova-compute[75258]:   </devices>
Nov 14 12:48:20 user nova-compute[75258]: </domain>
Nov 14 12:48:20 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T12:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-715727060',display_name='tempest-ServerActionsTestOtherA-server-839366482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-715727060',id=25,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6nOBmZS16HrsAcRDVYl1N9VVZlKCYS7vsVvKoBzd7OKlnMV1+Jxm/buZP9fLrIbNZp7VauNlpAeDzgdQNI3huVDLpo9eCIQ/k9KMnvgkmlp4agFaOxDXYwrXHYbT2qbQ==',key_name='tempest-keypair-149773274',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:46:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-buwy3nts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:48:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=7cadfc3a-d7a8-433e-b35e-c4021d78c529,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG os_vif [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1dfd1237-becc-57df-bbe4-821d7c01ccf2', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap96918577-6f, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap96918577-6f, col_values=(('qos', UUID('daaa4eb4-a474-4838-b747-0fe8658ee466')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap96918577-6f, col_values=(('external_ids', {'iface-id': '96918577-6f0a-4f2d-b038-8b1245a6a931', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:13:56:7b', 'vm-uuid': '7cadfc3a-d7a8-433e-b35e-c4021d78c529'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:20 user nova-compute[75258]: INFO os_vif [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f')
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No VIF found with MAC fa:16:3e:13:56:7b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance f91e625f-a68e-4da4-aeb8-067f96d649a2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance b498699b-b5f8-4428-bcde-b2893f600dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4b10c730-fbaa-453c-816d-945762eb6622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:48:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.584s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-9c39ec28-4246-4442-8f74-f4a84cdbc9e4 req-29dc050b-428f-4336-b1f1-8edb0bcad50d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9c39ec28-4246-4442-8f74-f4a84cdbc9e4 req-29dc050b-428f-4336-b1f1-8edb0bcad50d service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9c39ec28-4246-4442-8f74-f4a84cdbc9e4 req-29dc050b-428f-4336-b1f1-8edb0bcad50d service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9c39ec28-4246-4442-8f74-f4a84cdbc9e4 req-29dc050b-428f-4336-b1f1-8edb0bcad50d service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-9c39ec28-4246-4442-8f74-f4a84cdbc9e4 req-29dc050b-428f-4336-b1f1-8edb0bcad50d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:48:21 user nova-compute[75258]: WARNING nova.compute.manager [req-9c39ec28-4246-4442-8f74-f4a84cdbc9e4 req-29dc050b-428f-4336-b1f1-8edb0bcad50d service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received unexpected event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 12:48:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-512d5b41-742e-418d-9fb8-0c057fad4a79 req-47eac57a-c522-4d96-9e12-f9dc424a8fe4 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-512d5b41-742e-418d-9fb8-0c057fad4a79 req-47eac57a-c522-4d96-9e12-f9dc424a8fe4 service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-512d5b41-742e-418d-9fb8-0c057fad4a79 req-47eac57a-c522-4d96-9e12-f9dc424a8fe4 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-512d5b41-742e-418d-9fb8-0c057fad4a79 req-47eac57a-c522-4d96-9e12-f9dc424a8fe4 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-512d5b41-742e-418d-9fb8-0c057fad4a79 req-47eac57a-c522-4d96-9e12-f9dc424a8fe4 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:48:23 user nova-compute[75258]: WARNING nova.compute.manager [req-512d5b41-742e-418d-9fb8-0c057fad4a79 req-47eac57a-c522-4d96-9e12-f9dc424a8fe4 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received unexpected event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with vm_state active and task_state rebuild_spawning.
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:48:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance spawned successfully.
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:48:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:48:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Trying to apply a migration context that does not seem to be set for this instance {{(pid=75258) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1067}}
Nov 14 12:48:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-886f6b3f-a04e-49f4-b629-b8c3f893aff9 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.082s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:48:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:39 user nova-compute[75258]: INFO nova.compute.manager [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Terminating instance
Nov 14 12:48:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-fae9f155-628e-4afe-b8f2-34c96ff1eb56 req-feb674dc-5d3b-4dd6-bc13-89c9d7531b09 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-unplugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fae9f155-628e-4afe-b8f2-34c96ff1eb56 req-feb674dc-5d3b-4dd6-bc13-89c9d7531b09 service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fae9f155-628e-4afe-b8f2-34c96ff1eb56 req-feb674dc-5d3b-4dd6-bc13-89c9d7531b09 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fae9f155-628e-4afe-b8f2-34c96ff1eb56 req-feb674dc-5d3b-4dd6-bc13-89c9d7531b09 service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-fae9f155-628e-4afe-b8f2-34c96ff1eb56 req-feb674dc-5d3b-4dd6-bc13-89c9d7531b09 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No waiting events found dispatching network-vif-unplugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-fae9f155-628e-4afe-b8f2-34c96ff1eb56 req-feb674dc-5d3b-4dd6-bc13-89c9d7531b09 service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-unplugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:48:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Instance destroyed successfully.
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.objects.instance [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lazy-loading 'resources' on Instance uuid f91e625f-a68e-4da4-aeb8-067f96d649a2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T12:44:55Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1833133202',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1871672058',id=23,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQ4EpalNHCuF/5YOtbe9vY1rDMtV3ANQJGWd7bNGBYdS3J6OMVDpSn+QMjc5MdIMPIZVzscHiy5W+ETizBVxNGIKcEQFM+4lsGLUuCbAPdQKTUdKxiCItircAwA8jYSwA==',key_name='tempest-keypair-872410949',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:47:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='6554d9e28ce942b5933421198c41ff9a',ramdisk_id='',reservation_id='r-2p0el8ub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1507651178',owner_user_name='tempest-ServerActionsV293TestJSON-1507651178-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:47:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5ab782add99f4231b2d7bbfd078edf62',uuid=f91e625f-a68e-4da4-aeb8-067f96d649a2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converting VIF {"id": "7226e7fb-4e03-4182-a445-a30648b37027", "address": "fa:16:3e:e5:aa:15", "network": {"id": "a8cd924a-4f59-457e-a1f5-1061a337e4b9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-153274067-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.130", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "6554d9e28ce942b5933421198c41ff9a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7226e7fb-4e", "ovs_interfaceid": "7226e7fb-4e03-4182-a445-a30648b37027", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_vif [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7226e7fb-4e, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=92394b48-e949-4447-8367-2f3cac074ae3) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:40 user nova-compute[75258]: INFO os_vif [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e5:aa:15,bridge_name='br-int',has_traffic_filtering=True,id=7226e7fb-4e03-4182-a445-a30648b37027,network=Network(a8cd924a-4f59-457e-a1f5-1061a337e4b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7226e7fb-4e')
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'bUzKAPuo', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:40 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc62346e-631e-4ed6-91ba-63747bd1744a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:48:40 user nova-compute[75258]: No targets found.
Nov 14 12:48:40 user nova-compute[75258]: iSNS:
Nov 14 12:48:40 user nova-compute[75258]: No targets found.
Nov 14 12:48:40 user nova-compute[75258]: STATIC:
Nov 14 12:48:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:48:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:48:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13
Nov 14 12:48:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:48:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:48:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:48:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:48:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:48:40 user nova-compute[75258]: FIRMWARE:
Nov 14 12:48:40 user nova-compute[75258]: No targets found.
Nov 14 12:48:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:48:40 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:48:40 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[65547da9-d62d-4db2-89f3-dd3a6e1c7fbd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a2f5e8a-363e-425d-8266-ea7ba6eb1b5e]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:40 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b4277b50>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657d8c7-3bce-4554-9b6a-ebff4d3f3832]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36d38b9-374a-4b88-ac92-a6f92caff6b1]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb082c6-144b-4bb9-a35d-99c32e932d70]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce2d0f49-415b-4fcc-b4d6-d67536d184cc]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_bb27d7ff', '/dev/disk/by-id/scsi-1SCST_BIObb27d7ff-8d04f418ee80a99f', '/dev/disk/by-id/scsi-23864303466343138') {{(pid=86014) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad998e90-0bf2-4f18-94b9-d1e4663549ba]: (4, None) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57cf0d85-5ed5-45f7-901e-834a21aa39aa]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88fdd2e-2967-47f4-8e8a-89c8e31b0a35]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260]
Nov 14 12:48:40 user nova-compute[75258]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13, portal: 172.16.0.220,3260] successful.
Nov 14 12:48:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:dce3d526-3833-4dde-ab66-ffe18b83de13 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e52f2b04-0e94-4105-b15f-f5df29aa174f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] <== disconnect_volume: return (331ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:48:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Deleting instance files /opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2_del
Nov 14 12:48:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Deletion of /opt/stack/data/nova/instances/f91e625f-a68e-4da4-aeb8-067f96d649a2_del complete
Nov 14 12:48:40 user nova-compute[75258]: INFO nova.compute.manager [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Took 1.16 seconds to destroy the instance on the hypervisor.
Nov 14 12:48:40 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:48:40 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:48:41 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:48:41 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Took 0.89 seconds to deallocate network for instance.
Nov 14 12:48:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-ee3db216-1f9e-4c7e-9ea7-76a16388ae90 req-c9ed3df0-c5fa-4c1b-bcef-011deeccc07b service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-deleted-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-babe6506-2374-441f-8d2f-bd7306394c92 req-0aeb683b-e8cc-4d5a-8bc1-dda3f91f006a service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-babe6506-2374-441f-8d2f-bd7306394c92 req-0aeb683b-e8cc-4d5a-8bc1-dda3f91f006a service nova] Acquiring lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-babe6506-2374-441f-8d2f-bd7306394c92 req-0aeb683b-e8cc-4d5a-8bc1-dda3f91f006a service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-babe6506-2374-441f-8d2f-bd7306394c92 req-0aeb683b-e8cc-4d5a-8bc1-dda3f91f006a service nova] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-babe6506-2374-441f-8d2f-bd7306394c92 req-0aeb683b-e8cc-4d5a-8bc1-dda3f91f006a service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] No waiting events found dispatching network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:48:41 user nova-compute[75258]: WARNING nova.compute.manager [req-babe6506-2374-441f-8d2f-bd7306394c92 req-0aeb683b-e8cc-4d5a-8bc1-dda3f91f006a service nova] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Received unexpected event network-vif-plugged-7226e7fb-4e03-4182-a445-a30648b37027 for instance with vm_state active and task_state deleting.
Nov 14 12:48:42 user nova-compute[75258]: INFO nova.compute.manager [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 12:48:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] [instance: f91e625f-a68e-4da4-aeb8-067f96d649a2] Deleting volume: dce3d526-3833-4dde-ab66-ffe18b83de13 {{(pid=75258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 12:48:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:42 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:48:42 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:48:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.322s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:42 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Deleted allocations for instance f91e625f-a68e-4da4-aeb8-067f96d649a2
Nov 14 12:48:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77ae9af1-29ce-431f-ac34-698f23c6e077 tempest-ServerActionsV293TestJSON-1507651178 tempest-ServerActionsV293TestJSON-1507651178-project-member] Lock "f91e625f-a68e-4da4-aeb8-067f96d649a2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.350s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG nova.compute.manager [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received event network-changed-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG nova.compute.manager [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Refreshing instance network info cache due to event network-changed-58f18176-e928-4502-8e57-91ebb665a1a7. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] Acquiring lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] Acquired lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG nova.network.neutron [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Refreshing network info cache for port 58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG nova.network.neutron [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updated VIF entry in instance network info cache for port 58f18176-e928-4502-8e57-91ebb665a1a7. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG nova.network.neutron [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updating instance_info_cache with network_info: [{"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:48:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-75f24cd0-6bb5-4533-87bc-98ee39890a5f req-98a01f8b-e451-459d-bad1-e20d10d02679 service nova] Releasing lock "refresh_cache-b498699b-b5f8-4428-bcde-b2893f600dc1" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:48:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:44 user nova-compute[75258]: DEBUG nova.objects.instance [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.047s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:45 user nova-compute[75258]: INFO nova.compute.manager [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Attaching volume 3a0300bd-23d5-4f79-ba0e-89f329de07e8 to /dev/vdb
Nov 14 12:48:45 user nova-compute[75258]: DEBUG os_brick.utils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[580ab7ac-1f92-492c-becd-7d2ed02d6d3c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c9d337c-6b84-4ab2-a7f6-5a28f4fdee70]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d37a507-54dc-4cc3-8e08-674eb7cca35b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b3658ea-8dc0-4de4-ba36-ae22c01cdc5b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:45 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:48:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca9f450-e805-467c-be89-76d9b3ae29e4]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG os_brick.utils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:45 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updating existing volume attachment record: 8bdf1e70-c79c-4cb5-8b1e-8642214cab54 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtDgmhBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:49 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:49 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:49 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ea60c5-e410-4a2c-9e06-59ab494ad219]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:48:49 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba35f512-3185-4b59-ad12-db1ed2ff14af]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8] added
Nov 14 12:48:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[53db4817-45c7-4e3f-9adb-2dd0bdc0125b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[68367a18-e9ef-4e94-9a01-df9c833deb21]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtDgmhBS {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WtDgmhBS" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0a01aa7-6de6-4189-a5d2-e6cbc0e074f2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WtDgmhBS'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d056d1a7-b008-4c91-9cae-f03d708ecc83]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fc5a80d-3134-420e-9ef6-19d0596a9a6b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0882419c-46c9-4a85-848a-061695bb5ef2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260]
Nov 14 12:48:49 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260] successful.
Nov 14 12:48:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1873d97e-086a-4dde-81b7-491d8a5818eb]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[458fa0a0-1eee-4486-9e0e-e776e7fe3a62]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:49 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:48:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] HCTL ('33', '-', '-', 0) found on session 41 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f507720-e128-4d04-9c9b-d5e84f8aea29]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:48:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching for a device in session 41 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtDgmhBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.546s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== connect_volume: return (1547ms) {'type': 'block', 'scsi_wwn': '23361323336376561', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23361323336376561', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG nova.objects.instance [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:48:51 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:48:51 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:48:51 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:48:51 user nova-compute[75258]:   <serial>3a0300bd-23d5-4f79-ba0e-89f329de07e8</serial>
Nov 14 12:48:51 user nova-compute[75258]: </disk>
Nov 14 12:48:51 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No VIF found with MAC fa:16:3e:23:6e:8d, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:48:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d4eafc29-6994-4900-9af1-2162f9cb0aed tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.532s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG nova.objects.instance [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.060s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:48:54 user nova-compute[75258]: INFO nova.compute.manager [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Attaching volume 7a77cca8-6411-4c89-8cbc-31d11ce982cb to /dev/vdc
Nov 14 12:48:54 user nova-compute[75258]: DEBUG os_brick.utils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e772d78-e172-4645-96ae-f9e25c4f00d3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8532e20-aba2-4394-a6a1-224216dc9c4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ed4c5a-0795-422e-9631-1219dfe5db1b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[45809fc0-598d-4085-b1b9-7ee563bcabbe]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:48:54 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:48:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[16747858-f2b0-4d74-94b2-f75b854fe744]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG os_brick.utils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:48:54 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updating existing volume attachment record: a2b9d265-4a2b-4f89-afea-813c767d8eb8 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:48:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdnYGKJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:48:59 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:59 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:48:59 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14d068c-f8db-4fdb-9784-d6625a9e6ebd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:48:59 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[756a8a63-01ac-4dfc-8a8f-42e8cb189186]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb] added
Nov 14 12:48:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd357ee-1871-4c7e-b800-a92e42930cd6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c922b60-a664-400f-92ba-4ebdf354e578]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdnYGKJh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FdnYGKJh" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38ed916b-5cf8-4558-9864-3dc58a4492ff]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FdnYGKJh'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb62b18-0bde-4711-8a76-c3920e8d2dc7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5196949-b675-4ebd-b801-7c285c3e59f9]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --login" returned: 0 in 0.073s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae984a1-a856-4741-bcf0-3e02ce379ac6]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260]
Nov 14 12:48:59 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260] successful.
Nov 14 12:48:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd53bfef-1ce2-4527-8351-d87a4285d814]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ea3af0-76c8-4acf-88ca-fea37c3f8e8d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:48:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:48:59 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:48:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.329s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] HCTL ('39', '-', '-', 0) found on session 42 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad98fe59-dae5-4f85-bcb4-9d5486133092]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Searching for a device in session 42 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdnYGKJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:48:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.365s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== connect_volume: return (1368ms) {'type': 'block', 'scsi_wwn': '26333636331666339', 'path': '/dev/sdh'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26333636331666339', 'path': '/dev/sdh'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:49:00 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:00 user nova-compute[75258]:   <source dev="/dev/sdh"/>
Nov 14 12:49:00 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 12:49:00 user nova-compute[75258]:   <serial>7a77cca8-6411-4c89-8cbc-31d11ce982cb</serial>
Nov 14 12:49:00 user nova-compute[75258]: </disk>
Nov 14 12:49:00 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:49:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] No VIF found with MAC fa:16:3e:23:6e:8d, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:49:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-fad5c2fc-7a60-4ef2-a999-0ec47330476e tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.502s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:02 user nova-compute[75258]: INFO nova.compute.manager [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Detaching volume 3a0300bd-23d5-4f79-ba0e-89f329de07e8
Nov 14 12:49:02 user nova-compute[75258]: INFO nova.virt.block_device [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Attempting to driver detach volume 3a0300bd-23d5-4f79-ba0e-89f329de07e8 from mountpoint /dev/vdb
Nov 14 12:49:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Attempting to detach device vdb from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:49:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:49:02 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:02 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:49:02 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:49:02 user nova-compute[75258]:   <serial>3a0300bd-23d5-4f79-ba0e-89f329de07e8</serial>
Nov 14 12:49:02 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:49:02 user nova-compute[75258]: </disk>
Nov 14 12:49:02 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:49:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully detached device vdb from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the persistent domain config.
Nov 14 12:49:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:49:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:49:02 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:02 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:49:02 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:49:02 user nova-compute[75258]:   <serial>3a0300bd-23d5-4f79-ba0e-89f329de07e8</serial>
Nov 14 12:49:02 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:49:02 user nova-compute[75258]: </disk>
Nov 14 12:49:02 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:49:03 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:49:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:49:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [{"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-675b780c-92f9-41de-9457-ae035af15eeb" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:49:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:22 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:49:22 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7994MB free_disk=25.091617584228516GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 675b780c-92f9-41de-9457-ae035af15eeb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance b498699b-b5f8-4428-bcde-b2893f600dc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4b10c730-fbaa-453c-816d-945762eb6622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:49:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.397s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance b498699b-b5f8-4428-bcde-b2893f600dc1 is timed out.
Nov 14 12:49:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully detached device vdb from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the live domain config.
Nov 14 12:49:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WtDgmhBS', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:49:23 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[72b6b7af-9574-43db-b9ca-d481dc5f4ccc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:49:23 user nova-compute[75258]: No targets found.
Nov 14 12:49:23 user nova-compute[75258]: iSNS:
Nov 14 12:49:23 user nova-compute[75258]: No targets found.
Nov 14 12:49:23 user nova-compute[75258]: STATIC:
Nov 14 12:49:23 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:49:23 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:23 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:23 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:49:23 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:23 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:23 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb
Nov 14 12:49:23 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:23 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:23 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:49:23 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:23 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:23 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:49:23 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:23 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:23 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:49:23 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:23 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:23 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8
Nov 14 12:49:23 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:23 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:23 user nova-compute[75258]: FIRMWARE:
Nov 14 12:49:23 user nova-compute[75258]: No targets found.
Nov 14 12:49:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:49:23 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:49:23 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7caddef-bceb-4cf0-9a95-f88e78208976]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[85cb428d-0618-4185-9c01-fb79bd0dc73b]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 (non-flash)
Nov 14 12:49:23 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b41fd000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58887439-f1eb-48fd-900a-0c82b85822e6]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[610d6193-0278-457b-a11f-cd95f91e0f2b]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d821abed-92da-4921-9c0b-f68a8790a2ad]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aab687d9-740e-491e-8588-0df07eb6704e]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ff71a3-6b3b-472b-ac4c-69e2cb35cb57]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf85a822-e603-4de4-bb9d-d5496b7669a2]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260]
Nov 14 12:49:23 user nova-compute[75258]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8, portal: 172.16.0.220,3260] successful.
Nov 14 12:49:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a0300bd-23d5-4f79-ba0e-89f329de07e8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7f51b4d-7fa6-4472-a0dd-75025557167c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.358s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== disconnect_volume: return (359ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:49:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:49:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3259ff9f-db35-43fe-ab81-06fe7b9ce7a0 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.718s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:25 user nova-compute[75258]: INFO nova.compute.manager [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Detaching volume 7a77cca8-6411-4c89-8cbc-31d11ce982cb
Nov 14 12:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:25 user nova-compute[75258]: INFO nova.virt.block_device [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Attempting to driver detach volume 7a77cca8-6411-4c89-8cbc-31d11ce982cb from mountpoint /dev/vdc
Nov 14 12:49:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Attempting to detach device vdc from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:49:25 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:25 user nova-compute[75258]:   <source dev="/dev/sdh"/>
Nov 14 12:49:25 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 12:49:25 user nova-compute[75258]:   <serial>7a77cca8-6411-4c89-8cbc-31d11ce982cb</serial>
Nov 14 12:49:25 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 12:49:25 user nova-compute[75258]: </disk>
Nov 14 12:49:25 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:49:25 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully detached device vdc from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the persistent domain config.
Nov 14 12:49:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:49:25 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:25 user nova-compute[75258]:   <source dev="/dev/sdh"/>
Nov 14 12:49:25 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 12:49:25 user nova-compute[75258]:   <serial>7a77cca8-6411-4c89-8cbc-31d11ce982cb</serial>
Nov 14 12:49:25 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Nov 14 12:49:25 user nova-compute[75258]: </disk>
Nov 14 12:49:25 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:49:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:49:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing instance network info cache due to event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] Acquiring lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] Acquired lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG nova.network.neutron [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:49:31 user nova-compute[75258]: INFO nova.compute.manager [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Rescuing
Nov 14 12:49:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Updating instance_info_cache with network_info: [{"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG nova.network.neutron [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updated VIF entry in instance network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG nova.network.neutron [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.172", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8a681008-14d8-480d-93a7-140739d82f88 req-48242787-4f39-4b81-8ba2-26e6a2a5ad2f service nova] Releasing lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance destroyed successfully.
Nov 14 12:49:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Attempting a stable device rescue
Nov 14 12:49:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 12:49:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Creating image(s)
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "/opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "65a3047828bca187056d8ac3a55d2e487b30c5a0" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "65a3047828bca187056d8ac3a55d2e487b30c5a0" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-60e546e0-2af2-4f86-a84f-4841a8add695 req-6b9c0ee3-dbd2-418a-a260-8c52dcc2c284 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-60e546e0-2af2-4f86-a84f-4841a8add695 req-6b9c0ee3-dbd2-418a-a260-8c52dcc2c284 service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-60e546e0-2af2-4f86-a84f-4841a8add695 req-6b9c0ee3-dbd2-418a-a260-8c52dcc2c284 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-60e546e0-2af2-4f86-a84f-4841a8add695 req-6b9c0ee3-dbd2-418a-a260-8c52dcc2c284 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-60e546e0-2af2-4f86-a84f-4841a8add695 req-6b9c0ee3-dbd2-418a-a260-8c52dcc2c284 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:32 user nova-compute[75258]: WARNING nova.compute.manager [req-60e546e0-2af2-4f86-a84f-4841a8add695 req-6b9c0ee3-dbd2-418a-a260-8c52dcc2c284 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state active and task_state rescuing.
Nov 14 12:49:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:34 user nova-compute[75258]: INFO nova.compute.manager [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Detaching volume 85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:49:34 user nova-compute[75258]: INFO nova.virt.block_device [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Attempting to driver detach volume 85fed65a-e240-4016-ada1-6b9e5e4044ea from mountpoint /dev/vdb
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.part --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Attempting to detach device vdb from instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:49:34 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:34 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:49:34 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:49:34 user nova-compute[75258]:   <serial>85fed65a-e240-4016-ada1-6b9e5e4044ea</serial>
Nov 14 12:49:34 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 12:49:34 user nova-compute[75258]: </disk>
Nov 14 12:49:34 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.images [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] 12aa015c-3f65-4cf4-ab16-35e5cc337aeb was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.part /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:34 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully detached device vdb from instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 from the persistent domain config.
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:49:34 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:34 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:49:34 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:49:34 user nova-compute[75258]:   <serial>85fed65a-e240-4016-ada1-6b9e5e4044ea</serial>
Nov 14 12:49:34 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 12:49:34 user nova-compute[75258]: </disk>
Nov 14 12:49:34 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.part /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.converted" returned: 0 in 0.397s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0.converted --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "65a3047828bca187056d8ac3a55d2e487b30c5a0" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.795s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "65a3047828bca187056d8ac3a55d2e487b30c5a0" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "65a3047828bca187056d8ac3a55d2e487b30c5a0" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0 --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0,backing_fmt=raw /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0,backing_fmt=raw /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue" returned: 0 in 0.051s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "65a3047828bca187056d8ac3a55d2e487b30c5a0" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.235s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'migration_context' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.objects.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<4b10c730-fbaa-453c-816d-945762eb6622> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Start _get_guest_xml network_info=[{"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "vif_mac": "fa:16:3e:4c:0e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '12aa015c-3f65-4cf4-ab16-35e5cc337aeb', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APevbNsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': '4b10c730-fbaa-453c-816d-945762eb6622', 'attached_at': '', 'detached_at': '', 'volume_id': '4f963b11-7050-4946-873c-fb4638229fac', 'serial': '4f963b11-7050-4946-873c-fb4638229fac'}, 'device_type': 'disk', 'attachment_id': 'cfb1a14e-5652-470b-a91f-ba167327efcb', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'resources' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.objects.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<4b10c730-fbaa-453c-816d-945762eb6622> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'numa_topology' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:34 user nova-compute[75258]: DEBUG nova.objects.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<4b10c730-fbaa-453c-816d-945762eb6622> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:35 user nova-compute[75258]: WARNING nova.compute.manager [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state active and task_state rescuing.
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing instance network info cache due to event network-changed-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] Acquiring lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] Acquired lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Refreshing network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:49:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:49:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.objects.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<4b10c730-fbaa-453c-816d-945762eb6622> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APevbNsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:49:35 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:49:35 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:49:35 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb5c6ed-804d-4906-b1ff-af83cdb09dee]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = APevbNsJ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 12:49:35 user nova-compute[75258]: node.name = iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:49:35 user nova-compute[75258]: node.tpgt = -1
Nov 14 12:49:35 user nova-compute[75258]: node.startup = automatic
Nov 14 12:49:35 user nova-compute[75258]: node.leading_login = No
Nov 14 12:49:35 user nova-compute[75258]: iface.iscsi_ifacename = default
Nov 14 12:49:35 user nova-compute[75258]: iface.net_ifacename = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.ipaddress = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.prefix_len = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.hwaddress = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.transport_name = tcp
Nov 14 12:49:35 user nova-compute[75258]: iface.initiatorname = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.state = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.vlan_id = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.vlan_priority = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.vlan_state = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.iface_num = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.mtu = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.port = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.bootproto = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.subnet_mask = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.gateway = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_alt_client_id = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_dns = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_learn_iqn = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_vendor_id_state = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_vendor_id = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.dhcp_slp_da = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.fragmentation = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.gratuitous_arp = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.incoming_forwarding = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.tos_state = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.tos = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.ttl = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.delayed_ack = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.tcp_nagle = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.tcp_wsf_state = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.tcp_wsf = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.tcp_timer_scale = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.tcp_timestamp = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.redirect = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.def_task_mgmt_timeout = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.header_digest = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.data_digest = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.immediate_data = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.initial_r2t = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.data_seq_inorder = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.data_pdu_inorder = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.erl = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.max_receive_data_len = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.first_burst_len = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.max_outstanding_r2t = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.max_burst_len = 0
Nov 14 12:49:35 user nova-compute[75258]: iface.chap_auth = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.bidi_chap = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.strict_login_compliance = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.discovery_auth = <empty>
Nov 14 12:49:35 user nova-compute[75258]: iface.discovery_logout = <empty>
Nov 14 12:49:35 user nova-compute[75258]: node.discovery_address = <empty>
Nov 14 12:49:35 user nova-compute[75258]: node.discovery_port = 0
Nov 14 12:49:35 user nova-compute[75258]: node.discovery_type = static
Nov 14 12:49:35 user nova-compute[75258]: node.session.initial_cmdsn = 0
Nov 14 12:49:35 user nova-compute[75258]: node.session.initial_login_retry_max = 8
Nov 14 12:49:35 user nova-compute[75258]: node.session.xmit_thread_priority = -20
Nov 14 12:49:35 user nova-compute[75258]: node.session.cmds_max = 128
Nov 14 12:49:35 user nova-compute[75258]: node.session.queue_depth = 32
Nov 14 12:49:35 user nova-compute[75258]: node.session.nr_sessions = 1
Nov 14 12:49:35 user nova-compute[75258]: node.session.auth.authmethod = CHAP
Nov 14 12:49:35 user nova-compute[75258]: node.session.auth.username = APevbNsJ
Nov 14 12:49:35 user nova-compute[75258]: node.session.auth.password = ***
Nov 14 12:49:35 user nova-compute[75258]: node.session.auth.username_in = <empty>
Nov 14 12:49:35 user nova-compute[75258]: node.session.auth.password_in = <empty>
Nov 14 12:49:35 user nova-compute[75258]: node.session.auth.chap_algs = MD5
Nov 14 12:49:35 user nova-compute[75258]: node.session.timeo.replacement_timeout = 120
Nov 14 12:49:35 user nova-compute[75258]: node.session.err_timeo.abort_timeout = 15
Nov 14 12:49:35 user nova-compute[75258]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 12:49:35 user nova-compute[75258]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 12:49:35 user nova-compute[75258]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.FastAbort = Yes
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.InitialR2T = No
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.ImmediateData = Yes
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.MaxConnections = 1
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 12:49:35 user nova-compute[75258]: node.session.iscsi.ERL = 0
Nov 14 12:49:35 user nova-compute[75258]: node.session.scan = manual
Nov 14 12:49:35 user nova-compute[75258]: node.session.reopen_max = 0
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].address = 172.16.0.220
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].port = 3260
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].startup = manual
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].tcp.window_size = 524288
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].tcp.type_of_service = 0
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].timeo.logout_timeout = 15
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].timeo.login_timeout = 15
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].timeo.auth_timeout = 45
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].iscsi.DataDigest = None
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].iscsi.IFMarker = No
Nov 14 12:49:35 user nova-compute[75258]: node.conn[0].iscsi.OFMarker = No
Nov 14 12:49:35 user nova-compute[75258]: # END RECORD
Nov 14 12:49:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d9755ba-1aa9-4a2b-ac84-dcb96e9c93e1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[59bade37-4886-471d-ac26-42476e45c80c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APevbNsJ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.username -v APevbNsJ" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[59aea503-4850-44f6-b003-50a2fc22a51d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'APevbNsJ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[303c2d55-1d11-4d9c-b515-51bd61f30e07]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d331c7c6-4f99-43f3-82ce-f3b2c60b8a33]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:35 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.160s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] HCTL ('37', '0', '0', 0) found on session 38 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Scanning host 37 c: 0, t: 0, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c06e1d-177d-4cb2-9618-3546b6cf3898]: (4, ('0 0 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Searching for a device in session 38 and hctl ('37', '0', '0', 0) yield: sdf {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APevbNsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.186s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== connect_volume: return (187ms) {'type': 'block', 'scsi_wwn': '26438316636663938', 'path': '/dev/sdf'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26438316636663938', 'path': '/dev/sdf'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-623595415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-623595415',id=27,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:47:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-4q0pq0nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:47:56Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=4b10c730-fbaa-453c-816d-945762eb6622,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "vif_mac": "fa:16:3e:4c:0e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "vif_mac": "fa:16:3e:4c:0e:eb"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.objects.base [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Object Instance<4b10c730-fbaa-453c-816d-945762eb6622> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:49:35 user nova-compute[75258]:   <uuid>4b10c730-fbaa-453c-816d-945762eb6622</uuid>
Nov 14 12:49:35 user nova-compute[75258]:   <name>instance-0000001b</name>
Nov 14 12:49:35 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:49:35 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:49:35 user nova-compute[75258]:   <metadata>
Nov 14 12:49:35 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:49:35 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:49:35 user nova-compute[75258]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-623595415</nova:name>
Nov 14 12:49:35 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:49:35</nova:creationTime>
Nov 14 12:49:35 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:49:35 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:49:35 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:49:35 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:49:35 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:49:35 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:49:35 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:49:35 user nova-compute[75258]:       <nova:owner>
Nov 14 12:49:35 user nova-compute[75258]:         <nova:user uuid="cef85161135e4a978dd763ae91809be9">tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member</nova:user>
Nov 14 12:49:35 user nova-compute[75258]:         <nova:project uuid="c593ba588c7f442689362cda037f95f8">tempest-ServerBootFromVolumeStableRescueTest-1735756414</nova:project>
Nov 14 12:49:35 user nova-compute[75258]:       </nova:owner>
Nov 14 12:49:35 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:49:35 user nova-compute[75258]:       <nova:ports>
Nov 14 12:49:35 user nova-compute[75258]:         <nova:port uuid="71b3751d-f821-435d-b448-6fc50c8eb1a1">
Nov 14 12:49:35 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 12:49:35 user nova-compute[75258]:         </nova:port>
Nov 14 12:49:35 user nova-compute[75258]:       </nova:ports>
Nov 14 12:49:35 user nova-compute[75258]:     </nova:instance>
Nov 14 12:49:35 user nova-compute[75258]:   </metadata>
Nov 14 12:49:35 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:49:35 user nova-compute[75258]:     <system>
Nov 14 12:49:35 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:49:35 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:49:35 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:49:35 user nova-compute[75258]:       <entry name="serial">4b10c730-fbaa-453c-816d-945762eb6622</entry>
Nov 14 12:49:35 user nova-compute[75258]:       <entry name="uuid">4b10c730-fbaa-453c-816d-945762eb6622</entry>
Nov 14 12:49:35 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:49:35 user nova-compute[75258]:     </system>
Nov 14 12:49:35 user nova-compute[75258]:   </sysinfo>
Nov 14 12:49:35 user nova-compute[75258]:   <os>
Nov 14 12:49:35 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:49:35 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:49:35 user nova-compute[75258]:   </os>
Nov 14 12:49:35 user nova-compute[75258]:   <features>
Nov 14 12:49:35 user nova-compute[75258]:     <acpi/>
Nov 14 12:49:35 user nova-compute[75258]:     <apic/>
Nov 14 12:49:35 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:49:35 user nova-compute[75258]:   </features>
Nov 14 12:49:35 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:49:35 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:49:35 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:49:35 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:49:35 user nova-compute[75258]:   </clock>
Nov 14 12:49:35 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:49:35 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:49:35 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:49:35 user nova-compute[75258]:   </cpu>
Nov 14 12:49:35 user nova-compute[75258]:   <devices>
Nov 14 12:49:35 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:49:35 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:49:35 user nova-compute[75258]:       <source dev="/dev/sdf"/>
Nov 14 12:49:35 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:49:35 user nova-compute[75258]:       <serial>4f963b11-7050-4946-873c-fb4638229fac</serial>
Nov 14 12:49:35 user nova-compute[75258]:     </disk>
Nov 14 12:49:35 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:49:35 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:49:35 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue"/>
Nov 14 12:49:35 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:49:35 user nova-compute[75258]:       <boot order="1"/>
Nov 14 12:49:35 user nova-compute[75258]:     </disk>
Nov 14 12:49:35 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:49:35 user nova-compute[75258]:       <mac address="fa:16:3e:4c:0e:eb"/>
Nov 14 12:49:35 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:49:35 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:49:35 user nova-compute[75258]:       <target dev="tap71b3751d-f8"/>
Nov 14 12:49:35 user nova-compute[75258]:     </interface>
Nov 14 12:49:35 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:49:35 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/console.log" append="off"/>
Nov 14 12:49:35 user nova-compute[75258]:     </serial>
Nov 14 12:49:35 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:49:35 user nova-compute[75258]:     <video>
Nov 14 12:49:35 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:49:35 user nova-compute[75258]:     </video>
Nov 14 12:49:35 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:49:35 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:49:35 user nova-compute[75258]:     </rng>
Nov 14 12:49:35 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:49:35 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:49:35 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:49:35 user nova-compute[75258]:     </memballoon>
Nov 14 12:49:35 user nova-compute[75258]:   </devices>
Nov 14 12:49:35 user nova-compute[75258]: </domain>
Nov 14 12:49:35 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:49:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance destroyed successfully.
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] No VIF found with MAC fa:16:3e:4c:0e:eb, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updated VIF entry in instance network info cache for port c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [{"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1237180f-d336-4bff-aea9-efe72b1b630f req-a79f00fb-e01a-4f58-b189-76bd79bd7be9 service nova] Releasing lock "refresh_cache-a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-7be722bc-4472-4b72-b5ad-0ebc52800983 req-b4499e97-fd3e-465d-94bf-753f7e683fa9 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7be722bc-4472-4b72-b5ad-0ebc52800983 req-b4499e97-fd3e-465d-94bf-753f7e683fa9 service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7be722bc-4472-4b72-b5ad-0ebc52800983 req-b4499e97-fd3e-465d-94bf-753f7e683fa9 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7be722bc-4472-4b72-b5ad-0ebc52800983 req-b4499e97-fd3e-465d-94bf-753f7e683fa9 service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-7be722bc-4472-4b72-b5ad-0ebc52800983 req-b4499e97-fd3e-465d-94bf-753f7e683fa9 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:37 user nova-compute[75258]: WARNING nova.compute.manager [req-7be722bc-4472-4b72-b5ad-0ebc52800983 req-b4499e97-fd3e-465d-94bf-753f7e683fa9 service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state active and task_state rescuing.
Nov 14 12:49:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5b389ec9-dc54-40b4-8d10-b59f358b39df tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:49:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-e9dd7a27-cfad-4782-b7ee-bc31cdc3ca21 req-d5bed81a-26af-476c-a5d2-c08f3819836f service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e9dd7a27-cfad-4782-b7ee-bc31cdc3ca21 req-d5bed81a-26af-476c-a5d2-c08f3819836f service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e9dd7a27-cfad-4782-b7ee-bc31cdc3ca21 req-d5bed81a-26af-476c-a5d2-c08f3819836f service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e9dd7a27-cfad-4782-b7ee-bc31cdc3ca21 req-d5bed81a-26af-476c-a5d2-c08f3819836f service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-e9dd7a27-cfad-4782-b7ee-bc31cdc3ca21 req-d5bed81a-26af-476c-a5d2-c08f3819836f service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:39 user nova-compute[75258]: WARNING nova.compute.manager [req-e9dd7a27-cfad-4782-b7ee-bc31cdc3ca21 req-d5bed81a-26af-476c-a5d2-c08f3819836f service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state rescued and task_state None.
Nov 14 12:49:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:41 user nova-compute[75258]: INFO nova.compute.manager [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Terminating instance
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-dd6e3b42-97bf-43c3-bd5e-6ba42a61b2b5 req-a4bde4c4-eba3-4bca-a78b-1396283de1ca service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dd6e3b42-97bf-43c3-bd5e-6ba42a61b2b5 req-a4bde4c4-eba3-4bca-a78b-1396283de1ca service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dd6e3b42-97bf-43c3-bd5e-6ba42a61b2b5 req-a4bde4c4-eba3-4bca-a78b-1396283de1ca service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-dd6e3b42-97bf-43c3-bd5e-6ba42a61b2b5 req-a4bde4c4-eba3-4bca-a78b-1396283de1ca service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-dd6e3b42-97bf-43c3-bd5e-6ba42a61b2b5 req-a4bde4c4-eba3-4bca-a78b-1396283de1ca service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-dd6e3b42-97bf-43c3-bd5e-6ba42a61b2b5 req-a4bde4c4-eba3-4bca-a78b-1396283de1ca service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-unplugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:49:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Instance destroyed successfully.
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.objects.instance [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lazy-loading 'resources' on Instance uuid 675b780c-92f9-41de-9457-ae035af15eeb {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:41:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-112003904',display_name='tempest-ServerActionsTestOtherB-server-112003904',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-112003904',id=19,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAQsoTY2qPFM7XOdeG8AnPNSySXdpzjnUT8382GeatUGTwdQ8itLCz+U3cLFknTOxKAA9m4jjNDsT60wxE4EulaoYT0SXqtahjeHYWZu0MxEU248T27HQx5FxwxN1opTXA==',key_name='tempest-keypair-1581098711',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:47:05Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='e3597e92033a4fedafa79d98540cc451',ramdisk_id='',reservation_id='r-fw4t73lm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1658255901',owner_user_name='tempest-ServerActionsTestOtherB-1658255901-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:47:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='873cb2d85dba423c89f8a4fd99377a14',uuid=675b780c-92f9-41de-9457-ae035af15eeb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converting VIF {"id": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "address": "fa:16:3e:42:82:58", "network": {"id": "a533bb74-7a42-42a3-ae16-884540736b79", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1917800253-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.227", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "e3597e92033a4fedafa79d98540cc451", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf9fe5608-d5", "ovs_interfaceid": "f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_vif [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf9fe5608-d5, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=9d591b1a-f318-45d5-acd2-63ebacbb4993) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:49:41 user nova-compute[75258]: INFO os_vif [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:42:82:58,bridge_name='br-int',has_traffic_filtering=True,id=f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40,network=Network(a533bb74-7a42-42a3-ae16-884540736b79),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf9fe5608-d5')
Nov 14 12:49:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YxgHMlwq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:49:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13300f16-b1ad-49b7-99a4-86e5c4874bf7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:49:41 user nova-compute[75258]: No targets found.
Nov 14 12:49:41 user nova-compute[75258]: iSNS:
Nov 14 12:49:41 user nova-compute[75258]: No targets found.
Nov 14 12:49:41 user nova-compute[75258]: STATIC:
Nov 14 12:49:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:49:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:49:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb
Nov 14 12:49:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:49:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:49:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8
Nov 14 12:49:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:41 user nova-compute[75258]: FIRMWARE:
Nov 14 12:49:41 user nova-compute[75258]: No targets found.
Nov 14 12:49:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:49:41 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:49:41 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edc18ab5-384a-4166-9cfb-1656bd7105b0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d56a24-391a-4b4a-98c9-030696d4ddca]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:41 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c78e440>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa8aba2-cc32-4365-89e1-ca9c69c79d33]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b0c9279-0732-432b-8a44-3052111319b9]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7a627e9-6b8c-4431-ab07-8962fceca2a5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.051s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa15627-9099-4caa-856c-5982a191452e]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb43619a-d6d2-4fc5-bebe-49648e624731]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a416fa41-f260-443d-8d20-5754b6aab05b]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260]
Nov 14 12:49:42 user nova-compute[75258]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8, portal: 172.16.0.220,3260] successful.
Nov 14 12:49:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6120e31a-3661-4d2d-a8cf-34fbd55386c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[21d2603f-f17e-48ff-b9b6-33fdd50926b9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.353s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] <== disconnect_volume: return (354ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:49:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Deleting instance files /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb_del
Nov 14 12:49:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Deletion of /opt/stack/data/nova/instances/675b780c-92f9-41de-9457-ae035af15eeb_del complete
Nov 14 12:49:42 user nova-compute[75258]: INFO nova.compute.manager [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Took 1.29 seconds to destroy the instance on the hypervisor.
Nov 14 12:49:42 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:49:42 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:49:43 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:43 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Took 0.88 seconds to deallocate network for instance.
Nov 14 12:49:43 user nova-compute[75258]: DEBUG nova.compute.manager [req-da7413ce-19aa-4b6f-8118-0d99fb738013 req-4c22a24d-c0c3-4160-a8d2-cadbf956a34a service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-deleted-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:43 user nova-compute[75258]: DEBUG nova.compute.manager [req-10a3f3e7-ab5c-4473-88c6-c54c9e689a96 req-c9c2acb6-615f-4c52-8cba-092787c54cee service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-10a3f3e7-ab5c-4473-88c6-c54c9e689a96 req-c9c2acb6-615f-4c52-8cba-092787c54cee service nova] Acquiring lock "675b780c-92f9-41de-9457-ae035af15eeb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-10a3f3e7-ab5c-4473-88c6-c54c9e689a96 req-c9c2acb6-615f-4c52-8cba-092787c54cee service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-10a3f3e7-ab5c-4473-88c6-c54c9e689a96 req-c9c2acb6-615f-4c52-8cba-092787c54cee service nova] Lock "675b780c-92f9-41de-9457-ae035af15eeb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:43 user nova-compute[75258]: DEBUG nova.compute.manager [req-10a3f3e7-ab5c-4473-88c6-c54c9e689a96 req-c9c2acb6-615f-4c52-8cba-092787c54cee service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] No waiting events found dispatching network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:43 user nova-compute[75258]: WARNING nova.compute.manager [req-10a3f3e7-ab5c-4473-88c6-c54c9e689a96 req-c9c2acb6-615f-4c52-8cba-092787c54cee service nova] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Received unexpected event network-vif-plugged-f9fe5608-d5b0-4e9f-b0f7-b3a12a738a40 for instance with vm_state active and task_state deleting.
Nov 14 12:49:43 user nova-compute[75258]: INFO nova.compute.manager [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] [instance: 675b780c-92f9-41de-9457-ae035af15eeb] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.083s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:49:44 user nova-compute[75258]: INFO nova.compute.claims [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Claim successful on node user
Nov 14 12:49:44 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Deleted allocations for instance 675b780c-92f9-41de-9457-ae035af15eeb
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2a1797e4-0590-4058-9f5f-c6cdf0b10887 tempest-ServerActionsTestOtherB-1658255901 tempest-ServerActionsTestOtherB-1658255901-project-member] Lock "675b780c-92f9-41de-9457-ae035af15eeb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.447s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.375s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:49:44 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.policy [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ff4a59da80f249b891b10a581146f0dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '04ad4523c046417ba2124dce941487fa', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:49:44 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Creating image(s)
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Successfully created port: 0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk 1073741824" returned: 0 in 0.058s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.254s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance b498699b-b5f8-4428-bcde-b2893f600dc1 is timed out.
Nov 14 12:49:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully detached device vdc from instance b498699b-b5f8-4428-bcde-b2893f600dc1 from the live domain config.
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FdnYGKJh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:49:45 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Checking if we can resize image /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4862206-2153-41f8-9fd8-577ec26ee9ea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:49:45 user nova-compute[75258]: No targets found.
Nov 14 12:49:45 user nova-compute[75258]: iSNS:
Nov 14 12:49:45 user nova-compute[75258]: No targets found.
Nov 14 12:49:45 user nova-compute[75258]: STATIC:
Nov 14 12:49:45 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:49:45 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:45 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:45 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:49:45 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:45 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:45 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb
Nov 14 12:49:45 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:45 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:45 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:49:45 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:45 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:45 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:49:45 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:45 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:45 user nova-compute[75258]: FIRMWARE:
Nov 14 12:49:45 user nova-compute[75258]: No targets found.
Nov 14 12:49:45 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:49:45 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:49:45 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1802a20-ba62-4836-ad53-6ac7fecc4a74]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb344ca8-42a2-4525-a85d-918c2de2b9ec]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:45 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:45 user nova-compute[75258]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb (non-flash)
Nov 14 12:49:45 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c78e560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb'): ({'sdh'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Removing single pathed devices sdh {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[53ad3cba-bb6c-4ada-9d16-218a694b3601]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6810964e-9706-4d13-92ef-12330c4eab35]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Flushing IO for device /dev/sdh {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3533147-0da0-4b8c-b2b6-c6ab82506853]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Cannot resize image /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Ensure instance console log exists: /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.054s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1458bc-9542-43f9-81df-6ba70c7d9fd7]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] SCSI volumes sdh have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b028b71-615d-460c-b04e-bff44c8308fd]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24fc6525-82fe-4974-9c79-85b1d8cf9e0a]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260]
Nov 14 12:49:45 user nova-compute[75258]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb, portal: 172.16.0.220,3260] successful.
Nov 14 12:49:45 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7a77cca8-6411-4c89-8cbc-31d11ce982cb -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[400ee849-7a4c-4aee-85a9-050228928f16]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.348s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] <== disconnect_volume: return (350ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:49:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Successfully updated port: 0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing instance network info cache due to event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance network_info: |[{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Start _get_guest_xml network_info=[{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:49:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:49:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-310526585',display_name='tempest-ServerStableDeviceRescueTest-server-310526585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-310526585',id=28,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG2e4IB1za5Z+ErNPEkFDOSfaS97gX1KNSyYOquhPEa3PIidS2htvR8u3/MpC6Vg9o03CK36r386GijlvYb+EV9lJrjPsoT4y415VdDfbaJlxwPmUQILxfjzOis/P4JIA==',key_name='tempest-keypair-1454761844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ad4523c046417ba2124dce941487fa',ramdisk_id='',reservation_id='r-i2f82awa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-935137255',owner_user_name='tempest-ServerStableDeviceRescueTest-935137255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4a59da80f249b891b10a581146f0dd',uuid=94a7efee-d97e-4638-a2d7-2c526a0bc148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converting VIF {"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:49:46 user nova-compute[75258]:   <uuid>94a7efee-d97e-4638-a2d7-2c526a0bc148</uuid>
Nov 14 12:49:46 user nova-compute[75258]:   <name>instance-0000001c</name>
Nov 14 12:49:46 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:49:46 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:49:46 user nova-compute[75258]:   <metadata>
Nov 14 12:49:46 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:49:46 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:49:46 user nova-compute[75258]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-310526585</nova:name>
Nov 14 12:49:46 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:49:46</nova:creationTime>
Nov 14 12:49:46 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:49:46 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:49:46 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:49:46 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:49:46 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:49:46 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:49:46 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:49:46 user nova-compute[75258]:       <nova:owner>
Nov 14 12:49:46 user nova-compute[75258]:         <nova:user uuid="ff4a59da80f249b891b10a581146f0dd">tempest-ServerStableDeviceRescueTest-935137255-project-member</nova:user>
Nov 14 12:49:46 user nova-compute[75258]:         <nova:project uuid="04ad4523c046417ba2124dce941487fa">tempest-ServerStableDeviceRescueTest-935137255</nova:project>
Nov 14 12:49:46 user nova-compute[75258]:       </nova:owner>
Nov 14 12:49:46 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:49:46 user nova-compute[75258]:       <nova:ports>
Nov 14 12:49:46 user nova-compute[75258]:         <nova:port uuid="0f4ff176-a93c-4da3-97d1-a4bbf3de403a">
Nov 14 12:49:46 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 12:49:46 user nova-compute[75258]:         </nova:port>
Nov 14 12:49:46 user nova-compute[75258]:       </nova:ports>
Nov 14 12:49:46 user nova-compute[75258]:     </nova:instance>
Nov 14 12:49:46 user nova-compute[75258]:   </metadata>
Nov 14 12:49:46 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:49:46 user nova-compute[75258]:     <system>
Nov 14 12:49:46 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:49:46 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:49:46 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:49:46 user nova-compute[75258]:       <entry name="serial">94a7efee-d97e-4638-a2d7-2c526a0bc148</entry>
Nov 14 12:49:46 user nova-compute[75258]:       <entry name="uuid">94a7efee-d97e-4638-a2d7-2c526a0bc148</entry>
Nov 14 12:49:46 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:49:46 user nova-compute[75258]:     </system>
Nov 14 12:49:46 user nova-compute[75258]:   </sysinfo>
Nov 14 12:49:46 user nova-compute[75258]:   <os>
Nov 14 12:49:46 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:49:46 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:49:46 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:49:46 user nova-compute[75258]:   </os>
Nov 14 12:49:46 user nova-compute[75258]:   <features>
Nov 14 12:49:46 user nova-compute[75258]:     <acpi/>
Nov 14 12:49:46 user nova-compute[75258]:     <apic/>
Nov 14 12:49:46 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:49:46 user nova-compute[75258]:   </features>
Nov 14 12:49:46 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:49:46 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:49:46 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:49:46 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:49:46 user nova-compute[75258]:   </clock>
Nov 14 12:49:46 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:49:46 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:49:46 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:49:46 user nova-compute[75258]:   </cpu>
Nov 14 12:49:46 user nova-compute[75258]:   <devices>
Nov 14 12:49:46 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:49:46 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:49:46 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk"/>
Nov 14 12:49:46 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:49:46 user nova-compute[75258]:     </disk>
Nov 14 12:49:46 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:49:46 user nova-compute[75258]:       <mac address="fa:16:3e:63:41:94"/>
Nov 14 12:49:46 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:49:46 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:49:46 user nova-compute[75258]:       <target dev="tap0f4ff176-a9"/>
Nov 14 12:49:46 user nova-compute[75258]:     </interface>
Nov 14 12:49:46 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:49:46 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/console.log" append="off"/>
Nov 14 12:49:46 user nova-compute[75258]:     </serial>
Nov 14 12:49:46 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:49:46 user nova-compute[75258]:     <video>
Nov 14 12:49:46 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:49:46 user nova-compute[75258]:     </video>
Nov 14 12:49:46 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:49:46 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:49:46 user nova-compute[75258]:     </rng>
Nov 14 12:49:46 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:49:46 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:49:46 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:49:46 user nova-compute[75258]:     </memballoon>
Nov 14 12:49:46 user nova-compute[75258]:   </devices>
Nov 14 12:49:46 user nova-compute[75258]: </domain>
Nov 14 12:49:46 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-310526585',display_name='tempest-ServerStableDeviceRescueTest-server-310526585',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-310526585',id=28,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG2e4IB1za5Z+ErNPEkFDOSfaS97gX1KNSyYOquhPEa3PIidS2htvR8u3/MpC6Vg9o03CK36r386GijlvYb+EV9lJrjPsoT4y415VdDfbaJlxwPmUQILxfjzOis/P4JIA==',key_name='tempest-keypair-1454761844',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='04ad4523c046417ba2124dce941487fa',ramdisk_id='',reservation_id='r-i2f82awa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-935137255',owner_user_name='tempest-ServerStableDeviceRescueTest-935137255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:49:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4a59da80f249b891b10a581146f0dd',uuid=94a7efee-d97e-4638-a2d7-2c526a0bc148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converting VIF {"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG os_vif [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a29ddab1-2bed-5e82-8fcd-ef2bc184aa80', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0f4ff176-a9, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0f4ff176-a9, col_values=(('qos', UUID('c358817f-6952-450f-a606-df79a474ae4c')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0f4ff176-a9, col_values=(('external_ids', {'iface-id': '0f4ff176-a93c-4da3-97d1-a4bbf3de403a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:63:41:94', 'vm-uuid': '94a7efee-d97e-4638-a2d7-2c526a0bc148'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:46 user nova-compute[75258]: INFO os_vif [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9')
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No VIF found with MAC fa:16:3e:63:41:94, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'flavor' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-189910bc-6c97-4769-bda5-dfb68f4d80b6 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.654s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updated VIF entry in instance network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-79cb01f0-0e2e-4160-a91b-5338b2d589f7 req-b664ac54-004d-4538-9312-97b05e717b0f service nova] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:49:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-0b7bc157-3e84-4219-9ba2-bf22591c6f97 req-987ddfdd-888c-47d5-afd5-81ce40aa684b service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0b7bc157-3e84-4219-9ba2-bf22591c6f97 req-987ddfdd-888c-47d5-afd5-81ce40aa684b service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0b7bc157-3e84-4219-9ba2-bf22591c6f97 req-987ddfdd-888c-47d5-afd5-81ce40aa684b service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0b7bc157-3e84-4219-9ba2-bf22591c6f97 req-987ddfdd-888c-47d5-afd5-81ce40aa684b service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-0b7bc157-3e84-4219-9ba2-bf22591c6f97 req-987ddfdd-888c-47d5-afd5-81ce40aa684b service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:48 user nova-compute[75258]: WARNING nova.compute.manager [req-0b7bc157-3e84-4219-9ba2-bf22591c6f97 req-987ddfdd-888c-47d5-afd5-81ce40aa684b service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state building and task_state spawning.
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:48 user nova-compute[75258]: INFO nova.compute.manager [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Terminating instance
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Instance destroyed successfully.
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.objects.instance [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lazy-loading 'resources' on Instance uuid b498699b-b5f8-4428-bcde-b2893f600dc1 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:46:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-1773158513',display_name='tempest-AttachVolumeTestJSON-server-1773158513',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-1773158513',id=26,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoAB0Lv603GBKpm31SuEIVosbX1KOCr4MBU7xGFxcmYubPLyOq8oesu6Jw89/J4M9PmpjbLq51ckW33Q2KtHdn1SkVbV72KeF7TDaTR8t+SfWCig5E9CVJIdR72vaawPw==',key_name='tempest-keypair-1592269227',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:46:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='84d45cf00d6749eabfd3bc56b38a5d4a',ramdisk_id='',reservation_id='r-8mz1db88',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-528350005',owner_user_name='tempest-AttachVolumeTestJSON-528350005-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:46:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='807e1725870b4bca88785bd3f81aa06b',uuid=b498699b-b5f8-4428-bcde-b2893f600dc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converting VIF {"id": "58f18176-e928-4502-8e57-91ebb665a1a7", "address": "fa:16:3e:23:6e:8d", "network": {"id": "92b21a19-1784-4cea-a539-a280e5c094c1", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-1748327732-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.197", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "84d45cf00d6749eabfd3bc56b38a5d4a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap58f18176-e9", "ovs_interfaceid": "58f18176-e928-4502-8e57-91ebb665a1a7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:23:6e:8d,bridge_name='br-int',has_traffic_filtering=True,id=58f18176-e928-4502-8e57-91ebb665a1a7,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f18176-e9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG os_vif [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:6e:8d,bridge_name='br-int',has_traffic_filtering=True,id=58f18176-e928-4502-8e57-91ebb665a1a7,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f18176-e9') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap58f18176-e9, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b2b854e7-7b3e-4690-9e7f-dfd83b89a795) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:48 user nova-compute[75258]: INFO os_vif [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:23:6e:8d,bridge_name='br-int',has_traffic_filtering=True,id=58f18176-e928-4502-8e57-91ebb665a1a7,network=Network(92b21a19-1784-4cea-a539-a280e5c094c1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap58f18176-e9')
Nov 14 12:49:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Deleting instance files /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1_del
Nov 14 12:49:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Deletion of /opt/stack/data/nova/instances/b498699b-b5f8-4428-bcde-b2893f600dc1_del complete
Nov 14 12:49:48 user nova-compute[75258]: INFO nova.compute.manager [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 12:49:48 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:49:48 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:49:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:49 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:49 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Took 0.67 seconds to deallocate network for instance.
Nov 14 12:49:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d59853d0-a6b1-45f4-bd5c-0e8a21562151 req-543c7a8a-0405-44dc-81c8-5a1d859c1377 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received event network-vif-deleted-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:49 user nova-compute[75258]: INFO nova.compute.manager [req-d59853d0-a6b1-45f4-bd5c-0e8a21562151 req-543c7a8a-0405-44dc-81c8-5a1d859c1377 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Neutron deleted interface 58f18176-e928-4502-8e57-91ebb665a1a7; detaching it from the instance and deleting it from the info cache
Nov 14 12:49:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-d59853d0-a6b1-45f4-bd5c-0e8a21562151 req-543c7a8a-0405-44dc-81c8-5a1d859c1377 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:49:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d59853d0-a6b1-45f4-bd5c-0e8a21562151 req-543c7a8a-0405-44dc-81c8-5a1d859c1377 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Detach interface failed, port_id=58f18176-e928-4502-8e57-91ebb665a1a7, reason: Instance b498699b-b5f8-4428-bcde-b2893f600dc1 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:49:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:49 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:49:49 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:49:50 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance spawned successfully.
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:49:50 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Deleted allocations for instance b498699b-b5f8-4428-bcde-b2893f600dc1
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:49:50 user nova-compute[75258]: INFO nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Took 5.16 seconds to spawn the instance on the hypervisor.
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-89acdcd1-d154-4119-b051-20b4efd9ea74 tempest-AttachVolumeTestJSON-528350005 tempest-AttachVolumeTestJSON-528350005-project-member] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.039s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:50 user nova-compute[75258]: WARNING nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state building and task_state spawning.
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received event network-vif-unplugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] No waiting events found dispatching network-vif-unplugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:50 user nova-compute[75258]: WARNING nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received unexpected event network-vif-unplugged-58f18176-e928-4502-8e57-91ebb665a1a7 for instance with vm_state deleted and task_state None.
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received event network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Acquiring lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] Lock "b498699b-b5f8-4428-bcde-b2893f600dc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] No waiting events found dispatching network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:49:50 user nova-compute[75258]: WARNING nova.compute.manager [req-6626de41-d517-4851-af2b-fc3b849e87d2 req-bc540d0d-d6aa-4f99-ad11-d60633e1c011 service nova] [instance: b498699b-b5f8-4428-bcde-b2893f600dc1] Received unexpected event network-vif-plugged-58f18176-e928-4502-8e57-91ebb665a1a7 for instance with vm_state deleted and task_state None.
Nov 14 12:49:50 user nova-compute[75258]: INFO nova.compute.manager [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Took 6.01 seconds to build instance.
Nov 14 12:49:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02934c32-2cb7-4756-b1d5-2e651e67600e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.104s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:54 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 is timed out.
Nov 14 12:49:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully detached device vdb from instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 from the live domain config.
Nov 14 12:49:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'IXEomthZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:49:54 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80508272-5f42-4828-ba9c-bbd066762a8f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:49:54 user nova-compute[75258]: No targets found.
Nov 14 12:49:54 user nova-compute[75258]: iSNS:
Nov 14 12:49:54 user nova-compute[75258]: No targets found.
Nov 14 12:49:54 user nova-compute[75258]: STATIC:
Nov 14 12:49:54 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:49:54 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:54 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:54 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:49:54 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:54 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:54 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea
Nov 14 12:49:54 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:54 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:54 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:49:54 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:49:54 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:49:54 user nova-compute[75258]: FIRMWARE:
Nov 14 12:49:54 user nova-compute[75258]: No targets found.
Nov 14 12:49:54 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:49:54 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:49:54 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[209c4044-e291-42d2-8222-bc9e61707d5c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80ede8a1-9552-473e-9016-d5168687c417]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:54 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:54 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:54 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:54 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:49:54 user nova-compute[75258]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea (non-flash)
Nov 14 12:49:54 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:49:54 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:49:54 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c60b640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb1dae5-421d-48ea-9f3a-c877cac3ff56]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8707f952-9bd5-44e7-9abb-5dc8efbb0f3b]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3e60152-9075-4331-a096-cd21733485c3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:49:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[62177ecf-333d-49a8-a1c6-a2600caa54f1]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffd0d69a-839b-4dad-91d7-7d6562fe8cad]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff88192-3fa0-4ab1-a082-5c5a28e88046]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260]
Nov 14 12:49:55 user nova-compute[75258]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea, portal: 172.16.0.220,3260] successful.
Nov 14 12:49:55 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:85fed65a-e240-4016-ada1-6b9e5e4044ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e11e96a-1cd9-46d1-8315-939c620233bf]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.303s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== disconnect_volume: return (305ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG nova.objects.instance [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'flavor' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:49:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97905480-9972-468a-82a7-04a98bbaa88e tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.886s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:49:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:49:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:50:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:50:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:50:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:50:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:50:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:50:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:50:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:50:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:24 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:50:24 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8059MB free_disk=25.012439727783203GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4b10c730-fbaa-453c-816d-945762eb6622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:50:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=6GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:50:25 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:50:25 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:50:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:50:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.422s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:26 user nova-compute[75258]: INFO nova.compute.manager [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Terminating instance
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-629f107c-c75e-43e2-9345-a89f1fec7f60 req-86eec085-c678-4a47-8828-24c9fa35b0dc service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-unplugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-629f107c-c75e-43e2-9345-a89f1fec7f60 req-86eec085-c678-4a47-8828-24c9fa35b0dc service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-629f107c-c75e-43e2-9345-a89f1fec7f60 req-86eec085-c678-4a47-8828-24c9fa35b0dc service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-629f107c-c75e-43e2-9345-a89f1fec7f60 req-86eec085-c678-4a47-8828-24c9fa35b0dc service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-629f107c-c75e-43e2-9345-a89f1fec7f60 req-86eec085-c678-4a47-8828-24c9fa35b0dc service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-unplugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-629f107c-c75e-43e2-9345-a89f1fec7f60 req-86eec085-c678-4a47-8828-24c9fa35b0dc service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-unplugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:50:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Instance destroyed successfully.
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.objects.instance [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'resources' on Instance uuid a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:45:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-531669879',display_name='tempest-TestMinimumBasicScenario-server-531669879',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-531669879',id=24,image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO29bUilL5fawEGW6cAeHaeE8XFlTIQMLXwxAAuKiD5ZHgvRu1NB0NNWlX1KAbbqx9bYNwH4/3b7y1z39b8W3rj+AduXrWruaRuz/ztaJObf8rgea6b2vW0q+/RylnwMxA==',key_name='tempest-TestMinimumBasicScenario-1028670539',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:45:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-pxmq8c15',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='7e2e2167-92dd-4467-b8c8-8918acde57a6',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:47:46Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "address": "fa:16:3e:9a:66:9f", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc9b2ef09-6c", "ovs_interfaceid": "c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG os_vif [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc9b2ef09-6c, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=19758ab4-9f6d-4ffc-8f59-ca2eb1fc0aeb) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:50:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:50:26 user nova-compute[75258]: INFO os_vif [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9a:66:9f,bridge_name='br-int',has_traffic_filtering=True,id=c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc9b2ef09-6c')
Nov 14 12:50:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Deleting instance files /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138_del
Nov 14 12:50:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Deletion of /opt/stack/data/nova/instances/a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138_del complete
Nov 14 12:50:27 user nova-compute[75258]: INFO nova.compute.manager [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 12:50:27 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:50:27 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Took 0.37 seconds to deallocate network for instance.
Nov 14 12:50:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-58ac06dc-a03e-4cc8-b82f-1f89fe040883 req-abb7d49c-86e9-49c5-a55f-133ca596ff22 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-deleted-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:50:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.252s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:27 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Deleted allocations for instance a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138
Nov 14 12:50:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2f7d2a6d-c67a-49a2-b9d8-76f45f939f97 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.661s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-f7dabc72-9894-49e8-a914-3e0ea98b0322 req-0d89c2c4-9573-473f-8214-66b422eff115 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:50:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f7dabc72-9894-49e8-a914-3e0ea98b0322 req-0d89c2c4-9573-473f-8214-66b422eff115 service nova] Acquiring lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f7dabc72-9894-49e8-a914-3e0ea98b0322 req-0d89c2c4-9573-473f-8214-66b422eff115 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f7dabc72-9894-49e8-a914-3e0ea98b0322 req-0d89c2c4-9573-473f-8214-66b422eff115 service nova] Lock "a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-f7dabc72-9894-49e8-a914-3e0ea98b0322 req-0d89c2c4-9573-473f-8214-66b422eff115 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] No waiting events found dispatching network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:50:28 user nova-compute[75258]: WARNING nova.compute.manager [req-f7dabc72-9894-49e8-a914-3e0ea98b0322 req-0d89c2c4-9573-473f-8214-66b422eff115 service nova] [instance: a66a2a41-a7d3-43ea-b7e3-b5aa4a2bb138] Received unexpected event network-vif-plugged-c9b2ef09-6c55-4b7a-aa5d-299b0a6ef036 for instance with vm_state deleted and task_state None.
Nov 14 12:50:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:50:46 user nova-compute[75258]: INFO nova.compute.claims [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Claim successful on node user
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.377s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:50:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:50:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:50:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.policy [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d957bc3f2cf4beb931c5796ce2a4c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c080a084f2b8483894a1904531d152ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:50:47 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Creating image(s)
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "/opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.018s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk 1073741824" returned: 0 in 0.047s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Cannot resize image /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Ensure instance console log exists: /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Successfully created port: c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Successfully updated port: c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquired lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-changed-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Refreshing instance network info cache due to event network-changed-c4485ddb-95e4-4f03-9884-3f9f066fed05. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] Acquiring lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:50:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Updating instance_info_cache with network_info: [{"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Releasing lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Instance network_info: |[{"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] Acquired lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Refreshing network info cache for port c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Start _get_guest_xml network_info=[{"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:50:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:50:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874433275',display_name='tempest-AttachVolumeNegativeTest-server-874433275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874433275',id=29,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEZ+of53iIs70+PTJPFCFbWPQTeGEXjBuGgJzpnYp6J7BCrPHbjib9qVcq9mT11Cs1OigHsiPbkvtHH4RVcxZDOhSMA/zdXfvdXfSX0TBEK+qlTKwLIyscdoNv8PDF2IQ==',key_name='tempest-keypair-1476065429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-g0j1zbj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=58a3630a-6d1e-4538-b1d1-6c501fd5bc2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8a:be,bridge_name='br-int',has_traffic_filtering=True,id=c4485ddb-95e4-4f03-9884-3f9f066fed05,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4485ddb-95') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.objects.instance [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'pci_devices' on Instance uuid 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:50:49 user nova-compute[75258]:   <uuid>58a3630a-6d1e-4538-b1d1-6c501fd5bc2c</uuid>
Nov 14 12:50:49 user nova-compute[75258]:   <name>instance-0000001d</name>
Nov 14 12:50:49 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:50:49 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:50:49 user nova-compute[75258]:   <metadata>
Nov 14 12:50:49 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:50:49 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:50:49 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-874433275</nova:name>
Nov 14 12:50:49 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:50:49</nova:creationTime>
Nov 14 12:50:49 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:50:49 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:50:49 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:50:49 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:50:49 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:50:49 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:50:49 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:50:49 user nova-compute[75258]:       <nova:owner>
Nov 14 12:50:49 user nova-compute[75258]:         <nova:user uuid="0d957bc3f2cf4beb931c5796ce2a4c42">tempest-AttachVolumeNegativeTest-694932868-project-member</nova:user>
Nov 14 12:50:49 user nova-compute[75258]:         <nova:project uuid="c080a084f2b8483894a1904531d152ca">tempest-AttachVolumeNegativeTest-694932868</nova:project>
Nov 14 12:50:49 user nova-compute[75258]:       </nova:owner>
Nov 14 12:50:49 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:50:49 user nova-compute[75258]:       <nova:ports>
Nov 14 12:50:49 user nova-compute[75258]:         <nova:port uuid="c4485ddb-95e4-4f03-9884-3f9f066fed05">
Nov 14 12:50:49 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:50:49 user nova-compute[75258]:         </nova:port>
Nov 14 12:50:49 user nova-compute[75258]:       </nova:ports>
Nov 14 12:50:49 user nova-compute[75258]:     </nova:instance>
Nov 14 12:50:49 user nova-compute[75258]:   </metadata>
Nov 14 12:50:49 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:50:49 user nova-compute[75258]:     <system>
Nov 14 12:50:49 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:50:49 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:50:49 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:50:49 user nova-compute[75258]:       <entry name="serial">58a3630a-6d1e-4538-b1d1-6c501fd5bc2c</entry>
Nov 14 12:50:49 user nova-compute[75258]:       <entry name="uuid">58a3630a-6d1e-4538-b1d1-6c501fd5bc2c</entry>
Nov 14 12:50:49 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:50:49 user nova-compute[75258]:     </system>
Nov 14 12:50:49 user nova-compute[75258]:   </sysinfo>
Nov 14 12:50:49 user nova-compute[75258]:   <os>
Nov 14 12:50:49 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:50:49 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:50:49 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:50:49 user nova-compute[75258]:   </os>
Nov 14 12:50:49 user nova-compute[75258]:   <features>
Nov 14 12:50:49 user nova-compute[75258]:     <acpi/>
Nov 14 12:50:49 user nova-compute[75258]:     <apic/>
Nov 14 12:50:49 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:50:49 user nova-compute[75258]:   </features>
Nov 14 12:50:49 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:50:49 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:50:49 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:50:49 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:50:49 user nova-compute[75258]:   </clock>
Nov 14 12:50:49 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:50:49 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:50:49 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:50:49 user nova-compute[75258]:   </cpu>
Nov 14 12:50:49 user nova-compute[75258]:   <devices>
Nov 14 12:50:49 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:50:49 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:50:49 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk"/>
Nov 14 12:50:49 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:50:49 user nova-compute[75258]:     </disk>
Nov 14 12:50:49 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:50:49 user nova-compute[75258]:       <mac address="fa:16:3e:7e:8a:be"/>
Nov 14 12:50:49 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:50:49 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:50:49 user nova-compute[75258]:       <target dev="tapc4485ddb-95"/>
Nov 14 12:50:49 user nova-compute[75258]:     </interface>
Nov 14 12:50:49 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:50:49 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/console.log" append="off"/>
Nov 14 12:50:49 user nova-compute[75258]:     </serial>
Nov 14 12:50:49 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:50:49 user nova-compute[75258]:     <video>
Nov 14 12:50:49 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:50:49 user nova-compute[75258]:     </video>
Nov 14 12:50:49 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:50:49 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:50:49 user nova-compute[75258]:     </rng>
Nov 14 12:50:49 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:50:49 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:50:49 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:50:49 user nova-compute[75258]:     </memballoon>
Nov 14 12:50:49 user nova-compute[75258]:   </devices>
Nov 14 12:50:49 user nova-compute[75258]: </domain>
Nov 14 12:50:49 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874433275',display_name='tempest-AttachVolumeNegativeTest-server-874433275',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874433275',id=29,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEZ+of53iIs70+PTJPFCFbWPQTeGEXjBuGgJzpnYp6J7BCrPHbjib9qVcq9mT11Cs1OigHsiPbkvtHH4RVcxZDOhSMA/zdXfvdXfSX0TBEK+qlTKwLIyscdoNv8PDF2IQ==',key_name='tempest-keypair-1476065429',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-g0j1zbj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:50:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=58a3630a-6d1e-4538-b1d1-6c501fd5bc2c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8a:be,bridge_name='br-int',has_traffic_filtering=True,id=c4485ddb-95e4-4f03-9884-3f9f066fed05,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4485ddb-95') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG os_vif [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8a:be,bridge_name='br-int',has_traffic_filtering=True,id=c4485ddb-95e4-4f03-9884-3f9f066fed05,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4485ddb-95') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '80e35a9e-e962-5545-b6f0-245c94a17f87', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc4485ddb-95, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc4485ddb-95, col_values=(('qos', UUID('90cfe1ef-a646-4aba-b5ca-9e44b6aed9ab')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc4485ddb-95, col_values=(('external_ids', {'iface-id': 'c4485ddb-95e4-4f03-9884-3f9f066fed05', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7e:8a:be', 'vm-uuid': '58a3630a-6d1e-4538-b1d1-6c501fd5bc2c'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: INFO os_vif [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7e:8a:be,bridge_name='br-int',has_traffic_filtering=True,id=c4485ddb-95e4-4f03-9884-3f9f066fed05,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4485ddb-95')
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No VIF found with MAC fa:16:3e:7e:8a:be, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Updated VIF entry in instance network info cache for port c4485ddb-95e4-4f03-9884-3f9f066fed05. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Updating instance_info_cache with network_info: [{"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:50:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7caaed9b-f3f4-4c4d-b027-c51d4d870832 req-dbcf8130-a03f-436d-8ecc-a9a74eb1664c service nova] Releasing lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:50:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-cc5b5180-15ea-4d97-a03d-b0b53525581e req-6a216476-5351-4341-89af-55262a45a98b service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:50:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cc5b5180-15ea-4d97-a03d-b0b53525581e req-6a216476-5351-4341-89af-55262a45a98b service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cc5b5180-15ea-4d97-a03d-b0b53525581e req-6a216476-5351-4341-89af-55262a45a98b service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cc5b5180-15ea-4d97-a03d-b0b53525581e req-6a216476-5351-4341-89af-55262a45a98b service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-cc5b5180-15ea-4d97-a03d-b0b53525581e req-6a216476-5351-4341-89af-55262a45a98b service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:50:50 user nova-compute[75258]: WARNING nova.compute.manager [req-cc5b5180-15ea-4d97-a03d-b0b53525581e req-6a216476-5351-4341-89af-55262a45a98b service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received unexpected event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with vm_state building and task_state spawning.
Nov 14 12:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:50:52 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Instance spawned successfully.
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:50:52 user nova-compute[75258]: INFO nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Took 5.81 seconds to spawn the instance on the hypervisor.
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-d588614c-0ad3-4598-9768-22ca9075a95b req-a8f97782-bb3b-42de-991c-9e58d516aa45 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d588614c-0ad3-4598-9768-22ca9075a95b req-a8f97782-bb3b-42de-991c-9e58d516aa45 service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d588614c-0ad3-4598-9768-22ca9075a95b req-a8f97782-bb3b-42de-991c-9e58d516aa45 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d588614c-0ad3-4598-9768-22ca9075a95b req-a8f97782-bb3b-42de-991c-9e58d516aa45 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-d588614c-0ad3-4598-9768-22ca9075a95b req-a8f97782-bb3b-42de-991c-9e58d516aa45 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:50:52 user nova-compute[75258]: WARNING nova.compute.manager [req-d588614c-0ad3-4598-9768-22ca9075a95b req-a8f97782-bb3b-42de-991c-9e58d516aa45 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received unexpected event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with vm_state building and task_state spawning.
Nov 14 12:50:52 user nova-compute[75258]: INFO nova.compute.manager [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Took 6.53 seconds to build instance.
Nov 14 12:50:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2900e2a8-db56-4519-ac96-61f981164c38 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.621s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:50:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:50:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:01 user nova-compute[75258]: INFO nova.compute.manager [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Detaching volume 674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:51:01 user nova-compute[75258]: INFO nova.virt.block_device [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Attempting to driver detach volume 674c98a5-cddf-449c-b06f-3f143ef64e3c from mountpoint /dev/vdb
Nov 14 12:51:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Attempting to detach device vdb from instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:51:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:51:01 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:51:01 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:51:01 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:51:01 user nova-compute[75258]:   <serial>674c98a5-cddf-449c-b06f-3f143ef64e3c</serial>
Nov 14 12:51:01 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 12:51:01 user nova-compute[75258]: </disk>
Nov 14 12:51:01 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:51:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully detached device vdb from instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 from the persistent domain config.
Nov 14 12:51:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:51:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:51:01 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:51:01 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:51:01 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:51:01 user nova-compute[75258]:   <serial>674c98a5-cddf-449c-b06f-3f143ef64e3c</serial>
Nov 14 12:51:01 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 12:51:01 user nova-compute[75258]: </disk>
Nov 14 12:51:01 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:51:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:51:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Updating instance_info_cache with network_info: [{"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-9ddad9fb-2478-4c56-8522-afdc3b2b2632" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:51:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:51:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:51:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:51:20 user nova-compute[75258]: INFO nova.compute.claims [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Claim successful on node user
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:51:20 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.policy [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '46ecec8040474acc8f5104e2e906d4e8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4804d74a9a74c02b945b46f8c4e7183', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:51:20 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Creating image(s)
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "/opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "/opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "/opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "b0c121b1a020bfb90985b15cb2b8d798f3482e6e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "b0c121b1a020bfb90985b15cb2b8d798f3482e6e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Successfully created port: 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.part --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG nova.virt.images [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] 193fe459-9010-49db-a183-f0f688c19ae3 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.part /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.part /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.converted" returned: 0 in 0.472s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 is timed out.
Nov 14 12:51:22 user nova-compute[75258]: INFO nova.compute.manager [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Unrescuing
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquired lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.network.neutron [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:51:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully detached device vdb from instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 from the live domain config.
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmerEPKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:51:22 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0926ae9-9cbf-4c68-b20b-6c9979c4735e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:51:22 user nova-compute[75258]: No targets found.
Nov 14 12:51:22 user nova-compute[75258]: iSNS:
Nov 14 12:51:22 user nova-compute[75258]: No targets found.
Nov 14 12:51:22 user nova-compute[75258]: STATIC:
Nov 14 12:51:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:51:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:51:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:51:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:51:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:51:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:51:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c
Nov 14 12:51:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:51:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:51:22 user nova-compute[75258]: FIRMWARE:
Nov 14 12:51:22 user nova-compute[75258]: No targets found.
Nov 14 12:51:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:51:22 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:51:22 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e468de0-b752-48c4-8bf0-ebdfc79d4b05]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[83538a9b-4ccb-4292-9611-a64e0fe8720d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:51:22 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:51:22 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:51:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:51:22 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:51:22 user nova-compute[75258]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c (non-flash)
Nov 14 12:51:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4ac110550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c'): ({'sdg'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Removing single pathed devices sdg {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e.converted --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "b0c121b1a020bfb90985b15cb2b8d798f3482e6e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.519s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32b2f5ee-b347-40c3-b7a0-e567c275a150]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b44997e3-6334-47c9-b6e4-ef20d460464a]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flushing IO for device /dev/sdg {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Successfully updated port: 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[570624d4-eb4f-4c3d-a90c-92c15656b321]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing instance network info cache due to event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] Acquiring lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] Acquired lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e --force-share --output=json" returned: 0 in 0.206s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "b0c121b1a020bfb90985b15cb2b8d798f3482e6e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "b0c121b1a020bfb90985b15cb2b8d798f3482e6e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.037s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f79ee47d-11de-4226-8641-7bf355632978]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5c73b9-6d98-4cb3-b377-8e809587e557]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3d5a09-eda0-4800-91b6-35ff7d8d4de7]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260]
Nov 14 12:51:22 user nova-compute[75258]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c, portal: 172.16.0.220,3260] successful.
Nov 14 12:51:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:674c98a5-cddf-449c-b06f-3f143ef64e3c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2634973e-df9d-4dbb-9c90-961fb3805d26]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.511s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== disconnect_volume: return (517ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e,backing_fmt=raw /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.network.neutron [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Updating instance_info_cache with network_info: [{"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e,backing_fmt=raw /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk 1073741824" returned: 0 in 0.076s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "b0c121b1a020bfb90985b15cb2b8d798f3482e6e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.267s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Releasing lock "refresh_cache-4b10c730-fbaa-453c-816d-945762eb6622" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:51:22 user nova-compute[75258]: DEBUG nova.objects.instance [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'flavor' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.257s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.neutron [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-97718b6a-78e0-4955-adb3-9d61cfbfcb86 req-9ca39faf-187d-431f-ac45-f9252631c653 service nova] Releasing lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquired lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e --force-share --output=json" returned: 0 in 0.263s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.262s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Cannot resize image /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Ensure instance console log exists: /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-e2bb3db9-6f88-42ec-a2b4-c9508b532a0c req-0987c631-3e29-4315-8431-e82056c0f8cd service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e2bb3db9-6f88-42ec-a2b4-c9508b532a0c req-0987c631-3e29-4315-8431-e82056c0f8cd service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e2bb3db9-6f88-42ec-a2b4-c9508b532a0c req-0987c631-3e29-4315-8431-e82056c0f8cd service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e2bb3db9-6f88-42ec-a2b4-c9508b532a0c req-0987c631-3e29-4315-8431-e82056c0f8cd service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-e2bb3db9-6f88-42ec-a2b4-c9508b532a0c req-0987c631-3e29-4315-8431-e82056c0f8cd service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:23 user nova-compute[75258]: WARNING nova.compute.manager [req-e2bb3db9-6f88-42ec-a2b4-c9508b532a0c req-0987c631-3e29-4315-8431-e82056c0f8cd service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.232s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Releasing lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance network_info: |[{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Start _get_guest_xml network_info=[{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:51:17Z,direct_url=<?>,disk_format='qcow2',id=193fe459-9010-49db-a183-f0f688c19ae3,min_disk=0,min_ram=0,name='tempest-scenario-img--984716516',owner='c4804d74a9a74c02b945b46f8c4e7183',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:51:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': '193fe459-9010-49db-a183-f0f688c19ae3'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.228s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:51:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:51:17Z,direct_url=<?>,disk_format='qcow2',id=193fe459-9010-49db-a183-f0f688c19ae3,min_disk=0,min_ram=0,name='tempest-scenario-img--984716516',owner='c4804d74a9a74c02b945b46f8c4e7183',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:51:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431813287',display_name='tempest-TestMinimumBasicScenario-server-1431813287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431813287',id=30,image_ref='193fe459-9010-49db-a183-f0f688c19ae3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKQ68vihkwCPBlplouaoI/5NHyYi5zb2kksm7RqqzVGvyl7DOqbM498MFtmCZPZESDOgI1w61+5Fp6qf/G3ZQsu+NaaF4XmCY3VBl5SShOcl7EqCPQJsyYcYTRwGeAxw==',key_name='tempest-TestMinimumBasicScenario-910490175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-axep7ewp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='193fe459-9010-49db-a183-f0f688c19ae3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:51:21Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=2c78427a-e54f-4763-be94-b8e20263c6d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3f:a4,bridge_name='br-int',has_traffic_filtering=True,id=6d604cf0-6140-43b3-a2b0-8d4ab2b77cda,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d604cf0-61') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'pci_devices' on Instance uuid 2c78427a-e54f-4763-be94-b8e20263c6d9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:51:23 user nova-compute[75258]:   <uuid>2c78427a-e54f-4763-be94-b8e20263c6d9</uuid>
Nov 14 12:51:23 user nova-compute[75258]:   <name>instance-0000001e</name>
Nov 14 12:51:23 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:51:23 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:51:23 user nova-compute[75258]:   <metadata>
Nov 14 12:51:23 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:51:23 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:51:23 user nova-compute[75258]:       <nova:name>tempest-TestMinimumBasicScenario-server-1431813287</nova:name>
Nov 14 12:51:23 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:51:23</nova:creationTime>
Nov 14 12:51:23 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:51:23 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:51:23 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:51:23 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:51:23 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:51:23 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:51:23 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:51:23 user nova-compute[75258]:       <nova:owner>
Nov 14 12:51:23 user nova-compute[75258]:         <nova:user uuid="46ecec8040474acc8f5104e2e906d4e8">tempest-TestMinimumBasicScenario-30457951-project-member</nova:user>
Nov 14 12:51:23 user nova-compute[75258]:         <nova:project uuid="c4804d74a9a74c02b945b46f8c4e7183">tempest-TestMinimumBasicScenario-30457951</nova:project>
Nov 14 12:51:23 user nova-compute[75258]:       </nova:owner>
Nov 14 12:51:23 user nova-compute[75258]:       <nova:root type="image" uuid="193fe459-9010-49db-a183-f0f688c19ae3"/>
Nov 14 12:51:23 user nova-compute[75258]:       <nova:ports>
Nov 14 12:51:23 user nova-compute[75258]:         <nova:port uuid="6d604cf0-6140-43b3-a2b0-8d4ab2b77cda">
Nov 14 12:51:23 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 12:51:23 user nova-compute[75258]:         </nova:port>
Nov 14 12:51:23 user nova-compute[75258]:       </nova:ports>
Nov 14 12:51:23 user nova-compute[75258]:     </nova:instance>
Nov 14 12:51:23 user nova-compute[75258]:   </metadata>
Nov 14 12:51:23 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:51:23 user nova-compute[75258]:     <system>
Nov 14 12:51:23 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:51:23 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:51:23 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:51:23 user nova-compute[75258]:       <entry name="serial">2c78427a-e54f-4763-be94-b8e20263c6d9</entry>
Nov 14 12:51:23 user nova-compute[75258]:       <entry name="uuid">2c78427a-e54f-4763-be94-b8e20263c6d9</entry>
Nov 14 12:51:23 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:51:23 user nova-compute[75258]:     </system>
Nov 14 12:51:23 user nova-compute[75258]:   </sysinfo>
Nov 14 12:51:23 user nova-compute[75258]:   <os>
Nov 14 12:51:23 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:51:23 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:51:23 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:51:23 user nova-compute[75258]:   </os>
Nov 14 12:51:23 user nova-compute[75258]:   <features>
Nov 14 12:51:23 user nova-compute[75258]:     <acpi/>
Nov 14 12:51:23 user nova-compute[75258]:     <apic/>
Nov 14 12:51:23 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:51:23 user nova-compute[75258]:   </features>
Nov 14 12:51:23 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:51:23 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:51:23 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:51:23 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:51:23 user nova-compute[75258]:   </clock>
Nov 14 12:51:23 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:51:23 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:51:23 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:51:23 user nova-compute[75258]:   </cpu>
Nov 14 12:51:23 user nova-compute[75258]:   <devices>
Nov 14 12:51:23 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:51:23 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:51:23 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk"/>
Nov 14 12:51:23 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:51:23 user nova-compute[75258]:     </disk>
Nov 14 12:51:23 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:51:23 user nova-compute[75258]:       <mac address="fa:16:3e:2e:3f:a4"/>
Nov 14 12:51:23 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:51:23 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:51:23 user nova-compute[75258]:       <target dev="tap6d604cf0-61"/>
Nov 14 12:51:23 user nova-compute[75258]:     </interface>
Nov 14 12:51:23 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:51:23 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/console.log" append="off"/>
Nov 14 12:51:23 user nova-compute[75258]:     </serial>
Nov 14 12:51:23 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:51:23 user nova-compute[75258]:     <video>
Nov 14 12:51:23 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:51:23 user nova-compute[75258]:     </video>
Nov 14 12:51:23 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:51:23 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:51:23 user nova-compute[75258]:     </rng>
Nov 14 12:51:23 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:51:23 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:51:23 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:51:23 user nova-compute[75258]:     </memballoon>
Nov 14 12:51:23 user nova-compute[75258]:   </devices>
Nov 14 12:51:23 user nova-compute[75258]: </domain>
Nov 14 12:51:23 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431813287',display_name='tempest-TestMinimumBasicScenario-server-1431813287',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431813287',id=30,image_ref='193fe459-9010-49db-a183-f0f688c19ae3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKQ68vihkwCPBlplouaoI/5NHyYi5zb2kksm7RqqzVGvyl7DOqbM498MFtmCZPZESDOgI1w61+5Fp6qf/G3ZQsu+NaaF4XmCY3VBl5SShOcl7EqCPQJsyYcYTRwGeAxw==',key_name='tempest-TestMinimumBasicScenario-910490175',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-axep7ewp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='193fe459-9010-49db-a183-f0f688c19ae3',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:51:21Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=2c78427a-e54f-4763-be94-b8e20263c6d9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3f:a4,bridge_name='br-int',has_traffic_filtering=True,id=6d604cf0-6140-43b3-a2b0-8d4ab2b77cda,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d604cf0-61') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG os_vif [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3f:a4,bridge_name='br-int',has_traffic_filtering=True,id=6d604cf0-6140-43b3-a2b0-8d4ab2b77cda,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d604cf0-61') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e2da98da-7421-53e4-b935-b1e2a7d1ed75', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6d604cf0-61, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6d604cf0-61, col_values=(('qos', UUID('51f24b04-9225-425b-8351-f554742c8cbd')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6d604cf0-61, col_values=(('external_ids', {'iface-id': '6d604cf0-6140-43b3-a2b0-8d4ab2b77cda', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:3f:a4', 'vm-uuid': '2c78427a-e54f-4763-be94-b8e20263c6d9'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:23 user nova-compute[75258]: INFO os_vif [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:3f:a4,bridge_name='br-int',has_traffic_filtering=True,id=6d604cf0-6140-43b3-a2b0-8d4ab2b77cda,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d604cf0-61')
Nov 14 12:51:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:51:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance destroyed successfully.
Nov 14 12:51:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No VIF found with MAC fa:16:3e:2e:3f:a4, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json" returned: 0 in 0.218s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'flavor' on Instance uuid 7cadfc3a-d7a8-433e-b35e-c4021d78c529 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-80e5f52c-d32f-4838-99df-817a85ebb6b8 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 22.642s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622/disk.rescue --force-share --output=json" returned: 0 in 0.220s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.206s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-68a2a56d-6e85-4b02-89b2-e661f285e115 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-b788faad-490c-4bee-87a9-5f28bf34fc36 req-fd05306f-6c21-42b2-a28a-50bab61118de service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b788faad-490c-4bee-87a9-5f28bf34fc36 req-fd05306f-6c21-42b2-a28a-50bab61118de service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b788faad-490c-4bee-87a9-5f28bf34fc36 req-fd05306f-6c21-42b2-a28a-50bab61118de service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b788faad-490c-4bee-87a9-5f28bf34fc36 req-fd05306f-6c21-42b2-a28a-50bab61118de service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-b788faad-490c-4bee-87a9-5f28bf34fc36 req-fd05306f-6c21-42b2-a28a-50bab61118de service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:29 user nova-compute[75258]: WARNING nova.compute.manager [req-b788faad-490c-4bee-87a9-5f28bf34fc36 req-fd05306f-6c21-42b2-a28a-50bab61118de service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:29 user nova-compute[75258]: WARNING nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:29 user nova-compute[75258]: WARNING nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:29 user nova-compute[75258]: WARNING nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received unexpected event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with vm_state building and task_state spawning.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:29 user nova-compute[75258]: WARNING nova.compute.manager [req-3c101eff-1ce6-4aee-b095-f3805bc861d4 req-4e783af3-95b4-4479-b642-9eee16293ded service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received unexpected event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with vm_state building and task_state spawning.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:51:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:51:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8144MB free_disk=24.97916030883789GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:29 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance spawned successfully.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:51:29 user nova-compute[75258]: INFO nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Took 8.97 seconds to spawn the instance on the hypervisor.
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4b10c730-fbaa-453c-816d-945762eb6622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2c78427a-e54f-4763-be94-b8e20263c6d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:51:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:51:30 user nova-compute[75258]: INFO nova.compute.manager [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Took 9.79 seconds to build instance.
Nov 14 12:51:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ce123d36-3b82-4e4f-adde-a5b47211119b tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.901s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:30 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:51:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:51:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:51:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.520s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:51:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4968-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:51:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5009 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:51:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:51:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:51:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing instance network info cache due to event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updated VIF entry in instance network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:51:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0b975760-51d8-4a5b-9885-ef68d5e0ecc9 req-49a28aac-889b-413f-8f3c-ef063afb8284 service nova] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:51:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:51:36 user nova-compute[75258]: INFO nova.compute.manager [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] instance snapshotting
Nov 14 12:51:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Beginning live snapshot process
Nov 14 12:51:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json -f qcow2" returned: 0 in 0.230s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json -f qcow2" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp71ugu402/bc52129b4cbf454f810460d84875ab99.delta 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp71ugu402/bc52129b4cbf454f810460d84875ab99.delta 1073741824" returned: 0 in 0.055s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 12:51:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:51:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] COPY block job progress, current cursor: 24117248 final cursor: 75497472 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:51:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:51:39 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 12:51:39 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:51:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp71ugu402/bc52129b4cbf454f810460d84875ab99.delta /opt/stack/data/nova/instances/snapshots/tmp71ugu402/bc52129b4cbf454f810460d84875ab99 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:51:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp71ugu402/bc52129b4cbf454f810460d84875ab99.delta /opt/stack/data/nova/instances/snapshots/tmp71ugu402/bc52129b4cbf454f810460d84875ab99" returned: 0 in 0.604s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:51:39 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Snapshot extracted, beginning image upload
Nov 14 12:51:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Snapshot image upload complete
Nov 14 12:51:42 user nova-compute[75258]: INFO nova.compute.manager [None req-d1c85bea-2047-46d7-b359-179957688e6d tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Took 6.08 seconds to snapshot the instance on the hypervisor.
Nov 14 12:51:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:52 user nova-compute[75258]: INFO nova.compute.manager [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Terminating instance
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-bde99744-1734-4983-a207-7272251c0556 req-3ebd947f-4a8e-4cf7-83f2-b96e1bc92198 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-unplugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bde99744-1734-4983-a207-7272251c0556 req-3ebd947f-4a8e-4cf7-83f2-b96e1bc92198 service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bde99744-1734-4983-a207-7272251c0556 req-3ebd947f-4a8e-4cf7-83f2-b96e1bc92198 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bde99744-1734-4983-a207-7272251c0556 req-3ebd947f-4a8e-4cf7-83f2-b96e1bc92198 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-bde99744-1734-4983-a207-7272251c0556 req-3ebd947f-4a8e-4cf7-83f2-b96e1bc92198 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-unplugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-bde99744-1734-4983-a207-7272251c0556 req-3ebd947f-4a8e-4cf7-83f2-b96e1bc92198 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-unplugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:51:52 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Instance destroyed successfully.
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'resources' on Instance uuid 7cadfc3a-d7a8-433e-b35e-c4021d78c529 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T12:46:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-tempest.common.compute-instance-715727060',display_name='tempest-ServerActionsTestOtherA-server-839366482',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-tempest-common-compute-instance-715727060',id=25,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBA6nOBmZS16HrsAcRDVYl1N9VVZlKCYS7vsVvKoBzd7OKlnMV1+Jxm/buZP9fLrIbNZp7VauNlpAeDzgdQNI3huVDLpo9eCIQ/k9KMnvgkmlp4agFaOxDXYwrXHYbT2qbQ==',key_name='tempest-keypair-149773274',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:48:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-buwy3nts',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:48:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=7cadfc3a-d7a8-433e-b35e-c4021d78c529,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "96918577-6f0a-4f2d-b038-8b1245a6a931", "address": "fa:16:3e:13:56:7b", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.164", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap96918577-6f", "ovs_interfaceid": "96918577-6f0a-4f2d-b038-8b1245a6a931", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG os_vif [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap96918577-6f, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=daaa4eb4-a474-4838-b747-0fe8658ee466) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:51:52 user nova-compute[75258]: INFO os_vif [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:13:56:7b,bridge_name='br-int',has_traffic_filtering=True,id=96918577-6f0a-4f2d-b038-8b1245a6a931,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap96918577-6f')
Nov 14 12:51:52 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Deleting instance files /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529_del
Nov 14 12:51:52 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Deletion of /opt/stack/data/nova/instances/7cadfc3a-d7a8-433e-b35e-c4021d78c529_del complete
Nov 14 12:51:52 user nova-compute[75258]: INFO nova.compute.manager [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 12:51:52 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:51:52 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:51:54 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Took 1.14 seconds to deallocate network for instance.
Nov 14 12:51:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-55dc854a-76e2-498a-ad95-da000fc6fdd2 req-c773095d-9f74-4a1d-8e44-ccaaa1d98b37 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-deleted-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.293s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:54 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Deleted allocations for instance 7cadfc3a-d7a8-433e-b35e-c4021d78c529
Nov 14 12:51:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b47a0c11-a114-4767-a44e-e2ae92902aaa tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.488s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-df9005ed-3388-48f5-a8a9-c3a91a8b07db req-1e108c4a-f6c6-4b9e-a988-8f0730a5dfe4 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-df9005ed-3388-48f5-a8a9-c3a91a8b07db req-1e108c4a-f6c6-4b9e-a988-8f0730a5dfe4 service nova] Acquiring lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-df9005ed-3388-48f5-a8a9-c3a91a8b07db req-1e108c4a-f6c6-4b9e-a988-8f0730a5dfe4 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-df9005ed-3388-48f5-a8a9-c3a91a8b07db req-1e108c4a-f6c6-4b9e-a988-8f0730a5dfe4 service nova] Lock "7cadfc3a-d7a8-433e-b35e-c4021d78c529-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:51:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-df9005ed-3388-48f5-a8a9-c3a91a8b07db req-1e108c4a-f6c6-4b9e-a988-8f0730a5dfe4 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] No waiting events found dispatching network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:51:54 user nova-compute[75258]: WARNING nova.compute.manager [req-df9005ed-3388-48f5-a8a9-c3a91a8b07db req-1e108c4a-f6c6-4b9e-a988-8f0730a5dfe4 service nova] [instance: 7cadfc3a-d7a8-433e-b35e-c4021d78c529] Received unexpected event network-vif-plugged-96918577-6f0a-4f2d-b038-8b1245a6a931 for instance with vm_state deleted and task_state None.
Nov 14 12:51:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:51:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:52:00 user nova-compute[75258]: INFO nova.compute.claims [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Claim successful on node user
Nov 14 12:52:00 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.527s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:00 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:52:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.policy [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24ce11c0aea848fcbe316b293ceecdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcfbbc31fe74017ba6be81499ff7592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:52:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Creating image(s)
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "/opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "/opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "/opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk 1073741824" returned: 0 in 0.058s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Successfully created port: f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Checking if we can resize image /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Cannot resize image /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Ensure instance console log exists: /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Successfully updated port: f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquired lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-changed-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Refreshing instance network info cache due to event network-changed-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] Acquiring lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updating instance_info_cache with network_info: [{"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Releasing lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Instance network_info: |[{"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] Acquired lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Refreshing network info cache for port f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Start _get_guest_xml network_info=[{"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:52:02 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:52:02 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-605089217',display_name='tempest-TestStampPattern-server-605089217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-605089217',id=31,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jpfwPDiaw/GQ227J0mNoSTCU3OtL4gaaSJfLmw6zipgxzksWqHCtyLbWdzoVaIm0VPX7LvotObrlI//TM1p6iFvBovNg/Llgf/G+LW/rsG9r3i/SqUfLRUo5ZiUWfzQ==',key_name='tempest-TestStampPattern-1020160408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abcfbbc31fe74017ba6be81499ff7592',ramdisk_id='',reservation_id='r-hi5v8ijj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-253582314',owner_user_name='tempest-TestStampPattern-253582314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:52:01Z,user_data=None,user_id='24ce11c0aea848fcbe316b293ceecdf7',uuid=655df082-9b52-4bf6-8de5-e98f500e7454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converting VIF {"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:62:18,bridge_name='br-int',has_traffic_filtering=True,id=f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a6fcb7-42') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'pci_devices' on Instance uuid 655df082-9b52-4bf6-8de5-e98f500e7454 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:52:02 user nova-compute[75258]:   <uuid>655df082-9b52-4bf6-8de5-e98f500e7454</uuid>
Nov 14 12:52:02 user nova-compute[75258]:   <name>instance-0000001f</name>
Nov 14 12:52:02 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:52:02 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:52:02 user nova-compute[75258]:   <metadata>
Nov 14 12:52:02 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:52:02 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:52:02 user nova-compute[75258]:       <nova:name>tempest-TestStampPattern-server-605089217</nova:name>
Nov 14 12:52:02 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:52:02</nova:creationTime>
Nov 14 12:52:02 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:52:02 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:52:02 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:52:02 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:52:02 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:52:02 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:52:02 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:52:02 user nova-compute[75258]:       <nova:owner>
Nov 14 12:52:02 user nova-compute[75258]:         <nova:user uuid="24ce11c0aea848fcbe316b293ceecdf7">tempest-TestStampPattern-253582314-project-member</nova:user>
Nov 14 12:52:02 user nova-compute[75258]:         <nova:project uuid="abcfbbc31fe74017ba6be81499ff7592">tempest-TestStampPattern-253582314</nova:project>
Nov 14 12:52:02 user nova-compute[75258]:       </nova:owner>
Nov 14 12:52:02 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:52:02 user nova-compute[75258]:       <nova:ports>
Nov 14 12:52:02 user nova-compute[75258]:         <nova:port uuid="f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684">
Nov 14 12:52:02 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 12:52:02 user nova-compute[75258]:         </nova:port>
Nov 14 12:52:02 user nova-compute[75258]:       </nova:ports>
Nov 14 12:52:02 user nova-compute[75258]:     </nova:instance>
Nov 14 12:52:02 user nova-compute[75258]:   </metadata>
Nov 14 12:52:02 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:52:02 user nova-compute[75258]:     <system>
Nov 14 12:52:02 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:52:02 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:52:02 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:52:02 user nova-compute[75258]:       <entry name="serial">655df082-9b52-4bf6-8de5-e98f500e7454</entry>
Nov 14 12:52:02 user nova-compute[75258]:       <entry name="uuid">655df082-9b52-4bf6-8de5-e98f500e7454</entry>
Nov 14 12:52:02 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:52:02 user nova-compute[75258]:     </system>
Nov 14 12:52:02 user nova-compute[75258]:   </sysinfo>
Nov 14 12:52:02 user nova-compute[75258]:   <os>
Nov 14 12:52:02 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:52:02 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:52:02 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:52:02 user nova-compute[75258]:   </os>
Nov 14 12:52:02 user nova-compute[75258]:   <features>
Nov 14 12:52:02 user nova-compute[75258]:     <acpi/>
Nov 14 12:52:02 user nova-compute[75258]:     <apic/>
Nov 14 12:52:02 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:52:02 user nova-compute[75258]:   </features>
Nov 14 12:52:02 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:52:02 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:52:02 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:52:02 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:52:02 user nova-compute[75258]:   </clock>
Nov 14 12:52:02 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:52:02 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:52:02 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:52:02 user nova-compute[75258]:   </cpu>
Nov 14 12:52:02 user nova-compute[75258]:   <devices>
Nov 14 12:52:02 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:52:02 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:52:02 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk"/>
Nov 14 12:52:02 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:52:02 user nova-compute[75258]:     </disk>
Nov 14 12:52:02 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:52:02 user nova-compute[75258]:       <mac address="fa:16:3e:59:62:18"/>
Nov 14 12:52:02 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:52:02 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:52:02 user nova-compute[75258]:       <target dev="tapf0a6fcb7-42"/>
Nov 14 12:52:02 user nova-compute[75258]:     </interface>
Nov 14 12:52:02 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:52:02 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/console.log" append="off"/>
Nov 14 12:52:02 user nova-compute[75258]:     </serial>
Nov 14 12:52:02 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:52:02 user nova-compute[75258]:     <video>
Nov 14 12:52:02 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:52:02 user nova-compute[75258]:     </video>
Nov 14 12:52:02 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:52:02 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:52:02 user nova-compute[75258]:     </rng>
Nov 14 12:52:02 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:52:02 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:52:02 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:52:02 user nova-compute[75258]:     </memballoon>
Nov 14 12:52:02 user nova-compute[75258]:   </devices>
Nov 14 12:52:02 user nova-compute[75258]: </domain>
Nov 14 12:52:02 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-605089217',display_name='tempest-TestStampPattern-server-605089217',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-605089217',id=31,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jpfwPDiaw/GQ227J0mNoSTCU3OtL4gaaSJfLmw6zipgxzksWqHCtyLbWdzoVaIm0VPX7LvotObrlI//TM1p6iFvBovNg/Llgf/G+LW/rsG9r3i/SqUfLRUo5ZiUWfzQ==',key_name='tempest-TestStampPattern-1020160408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abcfbbc31fe74017ba6be81499ff7592',ramdisk_id='',reservation_id='r-hi5v8ijj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-253582314',owner_user_name='tempest-TestStampPattern-253582314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:52:01Z,user_data=None,user_id='24ce11c0aea848fcbe316b293ceecdf7',uuid=655df082-9b52-4bf6-8de5-e98f500e7454,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converting VIF {"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:59:62:18,bridge_name='br-int',has_traffic_filtering=True,id=f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a6fcb7-42') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG os_vif [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:62:18,bridge_name='br-int',has_traffic_filtering=True,id=f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a6fcb7-42') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2e9ee313-b59e-55ea-9590-a388e79d2204', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0a6fcb7-42, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf0a6fcb7-42, col_values=(('qos', UUID('25acd330-6f3b-4abe-97bb-361a548a8e26')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf0a6fcb7-42, col_values=(('external_ids', {'iface-id': 'f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:59:62:18', 'vm-uuid': '655df082-9b52-4bf6-8de5-e98f500e7454'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:02 user nova-compute[75258]: INFO os_vif [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:59:62:18,bridge_name='br-int',has_traffic_filtering=True,id=f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a6fcb7-42')
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No VIF found with MAC fa:16:3e:59:62:18, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updated VIF entry in instance network info cache for port f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:52:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updating instance_info_cache with network_info: [{"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:52:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2a61c5ef-c8eb-4d00-8960-906712ff5e22 req-500b10a7-397a-4f55-a837-3a9179a2be92 service nova] Releasing lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:52:04 user nova-compute[75258]: WARNING nova.compute.manager [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received unexpected event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with vm_state building and task_state spawning.
Nov 14 12:52:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:52:04 user nova-compute[75258]: WARNING nova.compute.manager [req-91d725f3-4c6f-4069-ab6b-88c6c4bf1fa7 req-4d53ca70-7ddf-4588-9c8b-128e08f7019e service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received unexpected event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with vm_state building and task_state spawning.
Nov 14 12:52:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:52:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Instance spawned successfully.
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:06 user nova-compute[75258]: INFO nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Took 5.19 seconds to spawn the instance on the hypervisor.
Nov 14 12:52:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:52:06 user nova-compute[75258]: INFO nova.compute.manager [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Took 6.07 seconds to build instance.
Nov 14 12:52:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6f5e84e5-5365-4860-adf4-130c5ce1ead5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.168s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:52:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:52:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.214s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:25 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:52:25 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7932MB free_disk=24.89942169189453GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4b10c730-fbaa-453c-816d-945762eb6622 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2c78427a-e54f-4763-be94-b8e20263c6d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 655df082-9b52-4bf6-8de5-e98f500e7454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:52:25 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:52:26 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:52:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 12:52:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 12:52:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:52:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 12:52:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-changed-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Refreshing instance network info cache due to event network-changed-c4485ddb-95e4-4f03-9884-3f9f066fed05. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] Acquiring lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] Acquired lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Refreshing network info cache for port c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Updated VIF entry in instance network info cache for port c4485ddb-95e4-4f03-9884-3f9f066fed05. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Updating instance_info_cache with network_info: [{"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-706a5d62-85ad-4c3f-8fd8-bc8471057c65 req-bded1f7e-75fe-4248-b25b-15eb6f3b2920 service nova] Releasing lock "refresh_cache-58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:52:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:39 user nova-compute[75258]: INFO nova.compute.manager [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Attaching volume d8803b6b-6006-4444-8a1b-ee5ff8a98e43 to /dev/vdb
Nov 14 12:52:39 user nova-compute[75258]: DEBUG os_brick.utils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd3db751-0606-461d-8171-dbedfc6368e6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0b378f-bc33-4fef-8d95-89667fe2505d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ac3451-affc-4840-814d-6bb970f8ee72]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9c0a654-f4f7-4f99-a8f0-be9159510711]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:52:39 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:52:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[294d3ebe-612a-48f6-9628-08cce374be7b]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG os_brick.utils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Updating existing volume attachment record: b61487f1-2c9c-4bce-9b6d-d63bb0e02d0e {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:52:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snGHfwSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:52:43 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:52:43 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:52:43 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf16216-91d1-4284-83e4-5ec87b63ebb1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:52:43 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ff4b23c-cad5-4d28-9dce-965f27114cee]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43] added
Nov 14 12:52:43 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c904b97-3c5e-433f-9801-48d7784f7903]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[752a3d88-be6b-4e07-8cca-e4adeceec3f0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snGHfwSp {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v snGHfwSp" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a857018-93a6-4780-8797-61ae5bb4edea]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'snGHfwSp'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6c718a7-0da7-405b-b7e4-1c24d935ed8d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a95a7-6839-4a1e-8a29-6d7f9f616035]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:52:43 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:52:43 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:52:43 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:52:43 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --login" returned: 0 in 0.063s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bbe73d-6d8a-4dd4-bef2-7def2af5d14d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260]
Nov 14 12:52:43 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260] successful.
Nov 14 12:52:43 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a5fa9b-0e66-41e2-a481-7f9cf9a5e896]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3d4cbb-47cf-431a-a711-2e66db68fd82]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:52:43 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:52:43 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:52:43 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:52:43 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:52:43 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:52:43 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] HCTL ('33', '-', '-', 0) found on session 43 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bc4afd5-3806-49c5-ab62-ca1747ece0b5]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching for a device in session 43 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:52:43 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snGHfwSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:52:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:44 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:52:44 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23536666163383631', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:52:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23536666163383631', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:52:44 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:52:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:52:44 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:52:44 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:52:44 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:52:44 user nova-compute[75258]:   <serial>d8803b6b-6006-4444-8a1b-ee5ff8a98e43</serial>
Nov 14 12:52:44 user nova-compute[75258]: </disk>
Nov 14 12:52:44 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:52:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:52:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:52:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No VIF found with MAC fa:16:3e:7e:8a:be, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:52:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b216098d-23d2-42c3-b1a3-e7eeaa402611 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.240s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:52:48 user nova-compute[75258]: INFO nova.compute.claims [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Claim successful on node user
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.403s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:52:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.policy [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d957bc3f2cf4beb931c5796ce2a4c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c080a084f2b8483894a1904531d152ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:52:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Creating image(s)
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "/opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk 1073741824" returned: 0 in 0.054s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Successfully created port: a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Cannot resize image /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Ensure instance console log exists: /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Successfully updated port: a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquired lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received event network-changed-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Refreshing instance network info cache due to event network-changed-a11a0db9-9ea7-46b9-b175-10a6bbe84661. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] Acquiring lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Updating instance_info_cache with network_info: [{"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Releasing lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Instance network_info: |[{"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] Acquired lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Refreshing network info cache for port a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Start _get_guest_xml network_info=[{"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:52:50 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:52:50 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624431003',display_name='tempest-AttachVolumeNegativeTest-server-624431003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-624431003',id=32,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPOH+NFP7Yes/ATHX9d/uuC61/+uQ80J+Qm4Cwqdo7j+1PGAHgHlakkm6+NMDJNHj3bh/K/jvKZ+ootHo1uw57dBbMg3nIrvSgYxjVmbgtG9rA/YW6bZzQ+4eystDGHog==',key_name='tempest-keypair-1084487634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-3o14uzme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=4cf466fa-a8fd-4ad7-811e-414dab7b1e47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e1:20,bridge_name='br-int',has_traffic_filtering=True,id=a11a0db9-9ea7-46b9-b175-10a6bbe84661,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa11a0db9-9e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.objects.instance [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'pci_devices' on Instance uuid 4cf466fa-a8fd-4ad7-811e-414dab7b1e47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:52:50 user nova-compute[75258]:   <uuid>4cf466fa-a8fd-4ad7-811e-414dab7b1e47</uuid>
Nov 14 12:52:50 user nova-compute[75258]:   <name>instance-00000020</name>
Nov 14 12:52:50 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:52:50 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:52:50 user nova-compute[75258]:   <metadata>
Nov 14 12:52:50 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:52:50 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:52:50 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-624431003</nova:name>
Nov 14 12:52:50 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:52:50</nova:creationTime>
Nov 14 12:52:50 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:52:50 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:52:50 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:52:50 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:52:50 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:52:50 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:52:50 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:52:50 user nova-compute[75258]:       <nova:owner>
Nov 14 12:52:50 user nova-compute[75258]:         <nova:user uuid="0d957bc3f2cf4beb931c5796ce2a4c42">tempest-AttachVolumeNegativeTest-694932868-project-member</nova:user>
Nov 14 12:52:50 user nova-compute[75258]:         <nova:project uuid="c080a084f2b8483894a1904531d152ca">tempest-AttachVolumeNegativeTest-694932868</nova:project>
Nov 14 12:52:50 user nova-compute[75258]:       </nova:owner>
Nov 14 12:52:50 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:52:50 user nova-compute[75258]:       <nova:ports>
Nov 14 12:52:50 user nova-compute[75258]:         <nova:port uuid="a11a0db9-9ea7-46b9-b175-10a6bbe84661">
Nov 14 12:52:50 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 12:52:50 user nova-compute[75258]:         </nova:port>
Nov 14 12:52:50 user nova-compute[75258]:       </nova:ports>
Nov 14 12:52:50 user nova-compute[75258]:     </nova:instance>
Nov 14 12:52:50 user nova-compute[75258]:   </metadata>
Nov 14 12:52:50 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:52:50 user nova-compute[75258]:     <system>
Nov 14 12:52:50 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:52:50 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:52:50 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:52:50 user nova-compute[75258]:       <entry name="serial">4cf466fa-a8fd-4ad7-811e-414dab7b1e47</entry>
Nov 14 12:52:50 user nova-compute[75258]:       <entry name="uuid">4cf466fa-a8fd-4ad7-811e-414dab7b1e47</entry>
Nov 14 12:52:50 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:52:50 user nova-compute[75258]:     </system>
Nov 14 12:52:50 user nova-compute[75258]:   </sysinfo>
Nov 14 12:52:50 user nova-compute[75258]:   <os>
Nov 14 12:52:50 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:52:50 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:52:50 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:52:50 user nova-compute[75258]:   </os>
Nov 14 12:52:50 user nova-compute[75258]:   <features>
Nov 14 12:52:50 user nova-compute[75258]:     <acpi/>
Nov 14 12:52:50 user nova-compute[75258]:     <apic/>
Nov 14 12:52:50 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:52:50 user nova-compute[75258]:   </features>
Nov 14 12:52:50 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:52:50 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:52:50 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:52:50 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:52:50 user nova-compute[75258]:   </clock>
Nov 14 12:52:50 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:52:50 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:52:50 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:52:50 user nova-compute[75258]:   </cpu>
Nov 14 12:52:50 user nova-compute[75258]:   <devices>
Nov 14 12:52:50 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:52:50 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:52:50 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk"/>
Nov 14 12:52:50 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:52:50 user nova-compute[75258]:     </disk>
Nov 14 12:52:50 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:52:50 user nova-compute[75258]:       <mac address="fa:16:3e:95:e1:20"/>
Nov 14 12:52:50 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:52:50 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:52:50 user nova-compute[75258]:       <target dev="tapa11a0db9-9e"/>
Nov 14 12:52:50 user nova-compute[75258]:     </interface>
Nov 14 12:52:50 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:52:50 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/console.log" append="off"/>
Nov 14 12:52:50 user nova-compute[75258]:     </serial>
Nov 14 12:52:50 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:52:50 user nova-compute[75258]:     <video>
Nov 14 12:52:50 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:52:50 user nova-compute[75258]:     </video>
Nov 14 12:52:50 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:52:50 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:52:50 user nova-compute[75258]:     </rng>
Nov 14 12:52:50 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:52:50 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:52:50 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:52:50 user nova-compute[75258]:     </memballoon>
Nov 14 12:52:50 user nova-compute[75258]:   </devices>
Nov 14 12:52:50 user nova-compute[75258]: </domain>
Nov 14 12:52:50 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624431003',display_name='tempest-AttachVolumeNegativeTest-server-624431003',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-624431003',id=32,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPOH+NFP7Yes/ATHX9d/uuC61/+uQ80J+Qm4Cwqdo7j+1PGAHgHlakkm6+NMDJNHj3bh/K/jvKZ+ootHo1uw57dBbMg3nIrvSgYxjVmbgtG9rA/YW6bZzQ+4eystDGHog==',key_name='tempest-keypair-1084487634',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-3o14uzme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:52:49Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=4cf466fa-a8fd-4ad7-811e-414dab7b1e47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e1:20,bridge_name='br-int',has_traffic_filtering=True,id=a11a0db9-9ea7-46b9-b175-10a6bbe84661,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa11a0db9-9e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG os_vif [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e1:20,bridge_name='br-int',has_traffic_filtering=True,id=a11a0db9-9ea7-46b9-b175-10a6bbe84661,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa11a0db9-9e') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b2281334-4c43-561e-a58b-caf56f535d8c', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa11a0db9-9e, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa11a0db9-9e, col_values=(('qos', UUID('aeffa830-3f78-4920-bb00-903d4eb42ed0')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa11a0db9-9e, col_values=(('external_ids', {'iface-id': 'a11a0db9-9ea7-46b9-b175-10a6bbe84661', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:95:e1:20', 'vm-uuid': '4cf466fa-a8fd-4ad7-811e-414dab7b1e47'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:50 user nova-compute[75258]: INFO os_vif [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e1:20,bridge_name='br-int',has_traffic_filtering=True,id=a11a0db9-9ea7-46b9-b175-10a6bbe84661,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa11a0db9-9e')
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No VIF found with MAC fa:16:3e:95:e1:20, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Updated VIF entry in instance network info cache for port a11a0db9-9ea7-46b9-b175-10a6bbe84661. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Updating instance_info_cache with network_info: [{"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:52:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-881b9645-c242-4e5b-815a-21dba93bd5c6 req-01f87369-ee1e-475a-bd4a-0359a780aca6 service nova] Releasing lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:52:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-b04f3b1d-8312-4aa0-b376-c0078d8e9aff req-5307827a-d0e5-4101-8df6-89713fffe0ae service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received event network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:52:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b04f3b1d-8312-4aa0-b376-c0078d8e9aff req-5307827a-d0e5-4101-8df6-89713fffe0ae service nova] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b04f3b1d-8312-4aa0-b376-c0078d8e9aff req-5307827a-d0e5-4101-8df6-89713fffe0ae service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b04f3b1d-8312-4aa0-b376-c0078d8e9aff req-5307827a-d0e5-4101-8df6-89713fffe0ae service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-b04f3b1d-8312-4aa0-b376-c0078d8e9aff req-5307827a-d0e5-4101-8df6-89713fffe0ae service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] No waiting events found dispatching network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:52:52 user nova-compute[75258]: WARNING nova.compute.manager [req-b04f3b1d-8312-4aa0-b376-c0078d8e9aff req-5307827a-d0e5-4101-8df6-89713fffe0ae service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received unexpected event network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 for instance with vm_state building and task_state spawning.
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:52:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Instance spawned successfully.
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:52:54 user nova-compute[75258]: INFO nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Took 5.32 seconds to spawn the instance on the hypervisor.
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:52:54 user nova-compute[75258]: INFO nova.compute.manager [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Took 6.06 seconds to build instance.
Nov 14 12:52:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-76626572-e13a-47df-83c0-194405fb7859 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.154s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-011c8fd6-2fc5-4485-b8bb-8662b243de51 req-add1ce8d-23c1-4c67-8ab9-103bbbc2a2b6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received event network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-011c8fd6-2fc5-4485-b8bb-8662b243de51 req-add1ce8d-23c1-4c67-8ab9-103bbbc2a2b6 service nova] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-011c8fd6-2fc5-4485-b8bb-8662b243de51 req-add1ce8d-23c1-4c67-8ab9-103bbbc2a2b6 service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-011c8fd6-2fc5-4485-b8bb-8662b243de51 req-add1ce8d-23c1-4c67-8ab9-103bbbc2a2b6 service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:52:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-011c8fd6-2fc5-4485-b8bb-8662b243de51 req-add1ce8d-23c1-4c67-8ab9-103bbbc2a2b6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] No waiting events found dispatching network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:52:54 user nova-compute[75258]: WARNING nova.compute.manager [req-011c8fd6-2fc5-4485-b8bb-8662b243de51 req-add1ce8d-23c1-4c67-8ab9-103bbbc2a2b6 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received unexpected event network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 for instance with vm_state active and task_state None.
Nov 14 12:52:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:52:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'flavor' on Instance uuid 2c78427a-e54f-4763-be94-b8e20263c6d9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:12 user nova-compute[75258]: INFO nova.compute.manager [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Attaching volume 4ba618c2-9c7d-4f49-a3d2-4e8760a356ae to /dev/vdb
Nov 14 12:53:12 user nova-compute[75258]: DEBUG os_brick.utils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04315b8f-7b4b-450e-a8c9-ab218af9e28f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18892c58-d0cf-40a9-afb0-290f4a18bf35]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e01ff95-5837-447d-9118-2b85a03e996a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b2edc2-9bf8-4c0b-be28-c1a8837bd558]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:12 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:53:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ad62316-a3f7-4276-99d7-04855ee2563f]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG os_brick.utils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== get_connector_properties: return (137ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:12 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating existing volume attachment record: f6b258dd-4624-437d-bb88-4216ceff0e21 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "4b10c730-fbaa-453c-816d-945762eb6622" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:13 user nova-compute[75258]: INFO nova.compute.manager [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Terminating instance
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-c7813452-d2d8-4a89-a10a-cc30b6fc3df4 req-a19596a1-84ec-4b80-895d-37ad567beeed service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c7813452-d2d8-4a89-a10a-cc30b6fc3df4 req-a19596a1-84ec-4b80-895d-37ad567beeed service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c7813452-d2d8-4a89-a10a-cc30b6fc3df4 req-a19596a1-84ec-4b80-895d-37ad567beeed service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c7813452-d2d8-4a89-a10a-cc30b6fc3df4 req-a19596a1-84ec-4b80-895d-37ad567beeed service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-c7813452-d2d8-4a89-a10a-cc30b6fc3df4 req-a19596a1-84ec-4b80-895d-37ad567beeed service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-c7813452-d2d8-4a89-a10a-cc30b6fc3df4 req-a19596a1-84ec-4b80-895d-37ad567beeed service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-unplugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:13 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Instance destroyed successfully.
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.objects.instance [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'resources' on Instance uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:47:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-623595415',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-623595415',id=27,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:49:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-4q0pq0nz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:51:30Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=4b10c730-fbaa-453c-816d-945762eb6622,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "address": "fa:16:3e:4c:0e:eb", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap71b3751d-f8", "ovs_interfaceid": "71b3751d-f821-435d-b448-6fc50c8eb1a1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG os_vif [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap71b3751d-f8, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:53:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2b69fc8-9c5a-4d89-abe8-fe7c41af9988) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:53:14 user nova-compute[75258]: INFO os_vif [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4c:0e:eb,bridge_name='br-int',has_traffic_filtering=True,id=71b3751d-f821-435d-b448-6fc50c8eb1a1,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap71b3751d-f8')
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'APevbNsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:14 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63bac321-e03e-444e-99d0-de83e2fcc650]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:53:14 user nova-compute[75258]: No targets found.
Nov 14 12:53:14 user nova-compute[75258]: iSNS:
Nov 14 12:53:14 user nova-compute[75258]: No targets found.
Nov 14 12:53:14 user nova-compute[75258]: STATIC:
Nov 14 12:53:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac
Nov 14 12:53:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:53:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:53:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:53:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:53:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:53:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43
Nov 14 12:53:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:53:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:53:14 user nova-compute[75258]: FIRMWARE:
Nov 14 12:53:14 user nova-compute[75258]: No targets found.
Nov 14 12:53:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:53:14 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:53:14 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36c74645-68da-4da3-a8bc-2fe6df8f7f2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2636c51-4849-4fbc-89f5-d3d7bac6491d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:14 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:53:14 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:14 user nova-compute[75258]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac (non-flash)
Nov 14 12:53:14 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c765ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac'): ({'sdf'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Removing single pathed devices sdf {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c6a5744-f3b6-46c5-bd7c-786b2e764647]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ac04b58-db12-4e7c-accd-6ac8c402650c]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flushing IO for device /dev/sdf {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d42fe4-a406-40be-b64b-c2936662ff4e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.048s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b36dbc8c-5036-444b-a887-ec7410afa6f9]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_dd3cfe63', '/dev/disk/by-id/scsi-26438316636663938', '/dev/disk/by-id/scsi-1SCST_BIOdd3cfe63-d81f6f98a7beed51') {{(pid=86014) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 12:53:14 user nova-compute[75258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-SSCST_BIO_Storage_dd3cfe63
Nov 14 12:53:14 user nova-compute[75258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-26438316636663938
Nov 14 12:53:14 user nova-compute[75258]: WARNING os_brick.exception [-] Unlink failed for /dev/disk/by-id/scsi-1SCST_BIOdd3cfe63-d81f6f98a7beed51
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8466697-728d-4443-a631-7883135f9c03]: (4, None) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbf067f1-48f9-47bf-bae9-523bc6604600]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c9d9de3-5775-4913-aa22-efbcac4b8c9e]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260]
Nov 14 12:53:14 user nova-compute[75258]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac, portal: 172.16.0.220,3260] successful.
Nov 14 12:53:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4f963b11-7050-4946-873c-fb4638229fac -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1469bd0-8510-40f4-9dab-dbd2cef7829e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.334s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== disconnect_volume: return (336ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:53:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Deleting instance files /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622_del
Nov 14 12:53:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Deletion of /opt/stack/data/nova/instances/4b10c730-fbaa-453c-816d-945762eb6622_del complete
Nov 14 12:53:14 user nova-compute[75258]: INFO nova.compute.manager [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Took 1.22 seconds to destroy the instance on the hypervisor.
Nov 14 12:53:14 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:14 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Took 0.48 seconds to deallocate network for instance.
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-a60c037c-83dd-4fd0-afb6-458ffeaeeb9a req-29fef6f1-89f8-4163-9340-ac52dfd065ad service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-deleted-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:14 user nova-compute[75258]: INFO nova.compute.manager [req-a60c037c-83dd-4fd0-afb6-458ffeaeeb9a req-29fef6f1-89f8-4163-9340-ac52dfd065ad service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Neutron deleted interface 71b3751d-f821-435d-b448-6fc50c8eb1a1; detaching it from the instance and deleting it from the info cache
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.network.neutron [req-a60c037c-83dd-4fd0-afb6-458ffeaeeb9a req-29fef6f1-89f8-4163-9340-ac52dfd065ad service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-a60c037c-83dd-4fd0-afb6-458ffeaeeb9a req-29fef6f1-89f8-4163-9340-ac52dfd065ad service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Detach interface failed, port_id=71b3751d-f821-435d-b448-6fc50c8eb1a1, reason: Instance 4b10c730-fbaa-453c-816d-945762eb6622 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:15 user nova-compute[75258]: WARNING nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] While synchronizing instance power states, found 10 instances in the database and 9 instances on the hypervisor.
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid dc99e2bd-9c7e-4b04-a92a-8be01f6db176 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 9ddad9fb-2478-4c56-8522-afdc3b2b2632 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 4b10c730-fbaa-453c-816d-945762eb6622 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 2c78427a-e54f-4763-be94-b8e20263c6d9 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 655df082-9b52-4bf6-8de5-e98f500e7454 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 4cf466fa-a8fd-4ad7-811e-414dab7b1e47 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-47766b04-f40e-42fd-9127-046df5d37cc6 req-ebf4327d-7b8b-4149-b461-e899b494cf4b service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-47766b04-f40e-42fd-9127-046df5d37cc6 req-ebf4327d-7b8b-4149-b461-e899b494cf4b service nova] Acquiring lock "4b10c730-fbaa-453c-816d-945762eb6622-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-47766b04-f40e-42fd-9127-046df5d37cc6 req-ebf4327d-7b8b-4149-b461-e899b494cf4b service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-47766b04-f40e-42fd-9127-046df5d37cc6 req-ebf4327d-7b8b-4149-b461-e899b494cf4b service nova] Lock "4b10c730-fbaa-453c-816d-945762eb6622-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-47766b04-f40e-42fd-9127-046df5d37cc6 req-ebf4327d-7b8b-4149-b461-e899b494cf4b service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] No waiting events found dispatching network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:15 user nova-compute[75258]: WARNING nova.compute.manager [req-47766b04-f40e-42fd-9127-046df5d37cc6 req-ebf4327d-7b8b-4149-b461-e899b494cf4b service nova] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Received unexpected event network-vif-plugged-71b3751d-f821-435d-b448-6fc50c8eb1a1 for instance with vm_state active and task_state deleting.
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.054s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.062s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.084s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.099s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.117s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:15 user nova-compute[75258]: INFO nova.compute.manager [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] Took 0.73 seconds to detach 1 volumes for instance.
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:53:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:53:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.399s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:16 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Deleted allocations for instance 4b10c730-fbaa-453c-816d-945762eb6622
Nov 14 12:53:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-78d062ba-2ef6-45d5-801c-5d592493541e tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "4b10c730-fbaa-453c-816d-945762eb6622" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.007s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "4b10c730-fbaa-453c-816d-945762eb6622" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.708s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:16 user nova-compute[75258]: INFO nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 4b10c730-fbaa-453c-816d-945762eb6622] During sync_power_state the instance has a pending task (deleting). Skip.
Nov 14 12:53:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "4b10c730-fbaa-453c-816d-945762eb6622" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrsSIKMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:17 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:17 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:17 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff5c5a79-d20a-4339-894f-a9bdd21479d6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:53:17 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02ebff4a-d770-402d-9f59-cbdfe473605d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae] added
Nov 14 12:53:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36303cd6-d692-43bc-81a0-105c112488b6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd6b8701-4858-44cd-9003-1b9e18059873]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrsSIKMG {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zrsSIKMG" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e96206b-9754-4fcf-8f79-15780700402e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zrsSIKMG'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b24badf-2389-475c-9ba2-829d4ad981e5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[910e67fd-8d24-4669-837f-8821b5415e0d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35f210a1-ff4b-407a-9fef-52c1b57037bf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260]
Nov 14 12:53:17 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260] successful.
Nov 14 12:53:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bad655e-fee9-4df2-b78a-636a4e7436b5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[60847801-5bac-4f07-a6a4-2f32622efec5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:17 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.298s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] HCTL ('35', '-', '-', 0) found on session 44 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d41bbc8-74ef-4647-b0fa-74032f2812cb]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Searching for a device in session 44 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:53:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrsSIKMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== connect_volume: return (1334ms) {'type': 'block', 'scsi_wwn': '23930363235363535', 'path': '/dev/sdd'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930363235363535', 'path': '/dev/sdd'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'flavor' on Instance uuid 2c78427a-e54f-4763-be94-b8e20263c6d9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:53:18 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:53:18 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:53:18 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:53:18 user nova-compute[75258]:   <serial>4ba618c2-9c7d-4f49-a3d2-4e8760a356ae</serial>
Nov 14 12:53:18 user nova-compute[75258]: </disk>
Nov 14 12:53:18 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [{"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:53:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] No VIF found with MAC fa:16:3e:2e:3f:a4, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4baf2161-eb7d-462a-81c5-1a895d8e4b70 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.464s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 3.717s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.050s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing instance network info cache due to event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] Acquiring lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] Acquired lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updated VIF entry in instance network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-70255b41-79ee-47b4-baa7-869e87e07e2c req-ec19b2c4-3cf3-4fec-a77c-2c9d37188812 service nova] Releasing lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing instance network info cache due to event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] Acquiring lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] Acquired lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updated VIF entry in instance network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:53:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a9761e26-0df5-4a54-bda1-f6ea3c78a4fc req-74714e16-059b-4251-9085-436d8daf1bd8 service nova] Releasing lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:25 user nova-compute[75258]: INFO nova.compute.manager [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Rebooting instance
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquired lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Releasing lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.004s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'flavor' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:27 user nova-compute[75258]: INFO nova.compute.manager [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Attaching volume 048e2e04-0357-4ab7-a6c6-c696a383f4a5 to /dev/vdb
Nov 14 12:53:27 user nova-compute[75258]: DEBUG os_brick.utils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4a7d5dd-9c18-4b64-aec5-c1d5ebe0bf65]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[160dce96-672d-4443-806a-bdee9fd06bb5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7006214-e175-4804-b58c-f3821fd165b8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a04f94ef-cf5e-4145-b57e-9fa9b8717754]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:28 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:53:28 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8018MB free_disk=24.86678695678711GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:28 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35d5efb9-d60a-4805-be3b-bc57b7f77a94]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG os_brick.utils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] <== get_connector_properties: return (519ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating existing volume attachment record: aaef02e2-88e8-4e25-b667-f21327d63b7e {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-f0725d6b-7f9c-4518-9533-cade0cf5c3cf req-4f6ab58b-b391-4682-83a1-e69b1bb1f84d service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-unplugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f0725d6b-7f9c-4518-9533-cade0cf5c3cf req-4f6ab58b-b391-4682-83a1-e69b1bb1f84d service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f0725d6b-7f9c-4518-9533-cade0cf5c3cf req-4f6ab58b-b391-4682-83a1-e69b1bb1f84d service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f0725d6b-7f9c-4518-9533-cade0cf5c3cf req-4f6ab58b-b391-4682-83a1-e69b1bb1f84d service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-f0725d6b-7f9c-4518-9533-cade0cf5c3cf req-4f6ab58b-b391-4682-83a1-e69b1bb1f84d service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-unplugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:28 user nova-compute[75258]: WARNING nova.compute.manager [req-f0725d6b-7f9c-4518-9533-cade0cf5c3cf req-4f6ab58b-b391-4682-83a1-e69b1bb1f84d service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received unexpected event network-vif-unplugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with vm_state active and task_state reboot_started.
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2c78427a-e54f-4763-be94-b8e20263c6d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 655df082-9b52-4bf6-8de5-e98f500e7454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4cf466fa-a8fd-4ad7-811e-414dab7b1e47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:53:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.601s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:29 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance shutdown successfully.
Nov 14 12:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-35faa80e-72b5-4e85-8cea-75fa3902cedf req-fcb688bf-fac8-4cdf-90ba-3f667666e2a0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-35faa80e-72b5-4e85-8cea-75fa3902cedf req-fcb688bf-fac8-4cdf-90ba-3f667666e2a0 service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-35faa80e-72b5-4e85-8cea-75fa3902cedf req-fcb688bf-fac8-4cdf-90ba-3f667666e2a0 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-35faa80e-72b5-4e85-8cea-75fa3902cedf req-fcb688bf-fac8-4cdf-90ba-3f667666e2a0 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-35faa80e-72b5-4e85-8cea-75fa3902cedf req-fcb688bf-fac8-4cdf-90ba-3f667666e2a0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:30 user nova-compute[75258]: WARNING nova.compute.manager [req-35faa80e-72b5-4e85-8cea-75fa3902cedf req-fcb688bf-fac8-4cdf-90ba-3f667666e2a0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received unexpected event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with vm_state active and task_state reboot_started.
Nov 14 12:53:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:32 user nova-compute[75258]: WARNING nova.compute.manager [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received unexpected event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with vm_state active and task_state reboot_started.
Nov 14 12:53:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:32 user nova-compute[75258]: WARNING nova.compute.manager [req-d7d48ad0-4c04-42e4-8d62-37ff77a32abf req-3d168914-6867-49e0-92d1-8d16961b8486 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received unexpected event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with vm_state active and task_state reboot_started.
Nov 14 12:53:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYfwBJGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:32 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:32 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:32 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e214a6d-1f90-4961-833c-d2f92b07129d]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:53:32 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1febe54-4f76-4ac8-8d4d-b1dc04b8a73a]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5] added
Nov 14 12:53:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1df4ef6-afd1-4a30-bf04-71e2db7365c0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8818c39e-c9aa-4b41-97de-3342edc6a81e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYfwBJGa {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYfwBJGa" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee30feb-c7f4-42d2-92b9-d80d8ebed658]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DYfwBJGa'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eab62e-3f01-4aa1-9246-de21103b5334]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea398b7-f309-4ebf-8129-d7235663a1e5]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --login" returned: 0 in 0.068s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[31ea3ae7-8e76-416c-80be-647118c10adf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260]
Nov 14 12:53:32 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260] successful.
Nov 14 12:53:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc0a4474-167c-40a1-8cfa-ad005e20f2d8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4043b797-f0b8-4ff7-8c5b-9aedce8d5af6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:32 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:32 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.286s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] HCTL ('36', '-', '-', 0) found on session 45 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1b5d68-f550-411b-ab7c-6b4d284e8969]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Searching for a device in session 45 and hctl ['36', '*', '*', 0] yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:53:32 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYfwBJGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:53:33 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance running successfully.
Nov 14 12:53:33 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance soft rebooted successfully.
Nov 14 12:53:33 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:53:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0b7ab523-2a0c-40f5-96ef-5845e59c2216 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.979s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.328s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23739343939636330', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739343939636330', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:53:33 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'flavor' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:53:33 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:53:33 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:53:33 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:53:33 user nova-compute[75258]:   <serial>048e2e04-0357-4ab7-a6c6-c696a383f4a5</serial>
Nov 14 12:53:33 user nova-compute[75258]: </disk>
Nov 14 12:53:33 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:53:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No VIF found with MAC fa:16:3e:63:41:94, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:53:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6c49386-81fa-489d-aa6c-9e4018539757 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.952s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:35 user nova-compute[75258]: INFO nova.compute.manager [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Rescuing
Nov 14 12:53:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:53:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-50f4def4-10d4-4e55-b9df-6aeb9c45625e req-5d67df8a-934d-446c-b82b-3f7cd33b35bb service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-50f4def4-10d4-4e55-b9df-6aeb9c45625e req-5d67df8a-934d-446c-b82b-3f7cd33b35bb service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-50f4def4-10d4-4e55-b9df-6aeb9c45625e req-5d67df8a-934d-446c-b82b-3f7cd33b35bb service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-50f4def4-10d4-4e55-b9df-6aeb9c45625e req-5d67df8a-934d-446c-b82b-3f7cd33b35bb service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-50f4def4-10d4-4e55-b9df-6aeb9c45625e req-5d67df8a-934d-446c-b82b-3f7cd33b35bb service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:36 user nova-compute[75258]: WARNING nova.compute.manager [req-50f4def4-10d4-4e55-b9df-6aeb9c45625e req-5d67df8a-934d-446c-b82b-3f7cd33b35bb service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state active and task_state rescuing.
Nov 14 12:53:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance destroyed successfully.
Nov 14 12:53:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Attempting a stable device rescue
Nov 14 12:53:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=75258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 12:53:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Creating image(s)
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'trusted_certs' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "cc7215a757fb92605369d25de18577a96379fc47" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "cc7215a757fb92605369d25de18577a96379fc47" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.images [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] 0ff3ede4-241c-43c5-85d0-d62457bcacb5 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.part /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-57e6d6d6-5141-4740-b765-3be1d1005ce8 req-cd9c5ecd-f7b6-4e09-8a3a-bd443ac9c0db service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-57e6d6d6-5141-4740-b765-3be1d1005ce8 req-cd9c5ecd-f7b6-4e09-8a3a-bd443ac9c0db service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-57e6d6d6-5141-4740-b765-3be1d1005ce8 req-cd9c5ecd-f7b6-4e09-8a3a-bd443ac9c0db service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-57e6d6d6-5141-4740-b765-3be1d1005ce8 req-cd9c5ecd-f7b6-4e09-8a3a-bd443ac9c0db service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-57e6d6d6-5141-4740-b765-3be1d1005ce8 req-cd9c5ecd-f7b6-4e09-8a3a-bd443ac9c0db service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:38 user nova-compute[75258]: WARNING nova.compute.manager [req-57e6d6d6-5141-4740-b765-3be1d1005ce8 req-cd9c5ecd-f7b6-4e09-8a3a-bd443ac9c0db service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state active and task_state rescuing.
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.part /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.converted" returned: 0 in 0.366s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47.converted --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "cc7215a757fb92605369d25de18577a96379fc47" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.795s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "cc7215a757fb92605369d25de18577a96379fc47" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "cc7215a757fb92605369d25de18577a96379fc47" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47 --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47,backing_fmt=raw /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47,backing_fmt=raw /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue" returned: 0 in 0.049s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "cc7215a757fb92605369d25de18577a96379fc47" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'migration_context' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Object Instance<94a7efee-d97e-4638-a2d7-2c526a0bc148> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Start _get_guest_xml network_info=[{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "vif_mac": "fa:16:3e:63:41:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '0ff3ede4-241c-43c5-85d0-d62457bcacb5', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYfwBJGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '94a7efee-d97e-4638-a2d7-2c526a0bc148', 'attached_at': '', 'detached_at': '', 'volume_id': '048e2e04-0357-4ab7-a6c6-c696a383f4a5', 'serial': '048e2e04-0357-4ab7-a6c6-c696a383f4a5'}, 'device_type': 'disk', 'attachment_id': 'aaef02e2-88e8-4e25-b667-f21327d63b7e', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdb', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'resources' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Object Instance<94a7efee-d97e-4638-a2d7-2c526a0bc148> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'numa_topology' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Object Instance<94a7efee-d97e-4638-a2d7-2c526a0bc148> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:53:38 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:53:38 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'vcpu_model' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:38 user nova-compute[75258]: DEBUG nova.objects.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Object Instance<94a7efee-d97e-4638-a2d7-2c526a0bc148> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYfwBJGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:39 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:39 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:39 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:53:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b343c812-d542-46b2-999a-86bfac3c9b7f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = DYfwBJGa\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Nov 14 12:53:39 user nova-compute[75258]: node.name = iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:53:39 user nova-compute[75258]: node.tpgt = -1
Nov 14 12:53:39 user nova-compute[75258]: node.startup = automatic
Nov 14 12:53:39 user nova-compute[75258]: node.leading_login = No
Nov 14 12:53:39 user nova-compute[75258]: iface.iscsi_ifacename = default
Nov 14 12:53:39 user nova-compute[75258]: iface.net_ifacename = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.ipaddress = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.prefix_len = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.hwaddress = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.transport_name = tcp
Nov 14 12:53:39 user nova-compute[75258]: iface.initiatorname = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.state = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.vlan_id = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.vlan_priority = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.vlan_state = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.iface_num = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.mtu = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.port = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.bootproto = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.subnet_mask = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.gateway = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_alt_client_id_state = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_alt_client_id = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_dns = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_learn_iqn = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_req_vendor_id_state = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_vendor_id_state = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_vendor_id = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.dhcp_slp_da = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.fragmentation = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.gratuitous_arp = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.incoming_forwarding = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.tos_state = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.tos = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.ttl = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.delayed_ack = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.tcp_nagle = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.tcp_wsf_state = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.tcp_wsf = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.tcp_timer_scale = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.tcp_timestamp = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.redirect = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.def_task_mgmt_timeout = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.header_digest = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.data_digest = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.immediate_data = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.initial_r2t = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.data_seq_inorder = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.data_pdu_inorder = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.erl = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.max_receive_data_len = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.first_burst_len = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.max_outstanding_r2t = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.max_burst_len = 0
Nov 14 12:53:39 user nova-compute[75258]: iface.chap_auth = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.bidi_chap = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.strict_login_compliance = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.discovery_auth = <empty>
Nov 14 12:53:39 user nova-compute[75258]: iface.discovery_logout = <empty>
Nov 14 12:53:39 user nova-compute[75258]: node.discovery_address = <empty>
Nov 14 12:53:39 user nova-compute[75258]: node.discovery_port = 0
Nov 14 12:53:39 user nova-compute[75258]: node.discovery_type = static
Nov 14 12:53:39 user nova-compute[75258]: node.session.initial_cmdsn = 0
Nov 14 12:53:39 user nova-compute[75258]: node.session.initial_login_retry_max = 8
Nov 14 12:53:39 user nova-compute[75258]: node.session.xmit_thread_priority = -20
Nov 14 12:53:39 user nova-compute[75258]: node.session.cmds_max = 128
Nov 14 12:53:39 user nova-compute[75258]: node.session.queue_depth = 32
Nov 14 12:53:39 user nova-compute[75258]: node.session.nr_sessions = 1
Nov 14 12:53:39 user nova-compute[75258]: node.session.auth.authmethod = CHAP
Nov 14 12:53:39 user nova-compute[75258]: node.session.auth.username = DYfwBJGa
Nov 14 12:53:39 user nova-compute[75258]: node.session.auth.password = ***
Nov 14 12:53:39 user nova-compute[75258]: node.session.auth.username_in = <empty>
Nov 14 12:53:39 user nova-compute[75258]: node.session.auth.password_in = <empty>
Nov 14 12:53:39 user nova-compute[75258]: node.session.auth.chap_algs = MD5
Nov 14 12:53:39 user nova-compute[75258]: node.session.timeo.replacement_timeout = 120
Nov 14 12:53:39 user nova-compute[75258]: node.session.err_timeo.abort_timeout = 15
Nov 14 12:53:39 user nova-compute[75258]: node.session.err_timeo.lu_reset_timeout = 30
Nov 14 12:53:39 user nova-compute[75258]: node.session.err_timeo.tgt_reset_timeout = 30
Nov 14 12:53:39 user nova-compute[75258]: node.session.err_timeo.host_reset_timeout = 60
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.FastAbort = Yes
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.InitialR2T = No
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.ImmediateData = Yes
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.FirstBurstLength = 262144
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.MaxBurstLength = 16776192
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.DefaultTime2Retain = 0
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.DefaultTime2Wait = 2
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.MaxConnections = 1
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.MaxOutstandingR2T = 1
Nov 14 12:53:39 user nova-compute[75258]: node.session.iscsi.ERL = 0
Nov 14 12:53:39 user nova-compute[75258]: node.session.scan = manual
Nov 14 12:53:39 user nova-compute[75258]: node.session.reopen_max = 0
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].address = 172.16.0.220
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].port = 3260
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].startup = manual
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].tcp.window_size = 524288
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].tcp.type_of_service = 0
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].timeo.logout_timeout = 15
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].timeo.login_timeout = 15
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].timeo.auth_timeout = 45
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].timeo.noop_out_interval = 5
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].timeo.noop_out_timeout = 5
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].iscsi.HeaderDigest = None
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].iscsi.DataDigest = None
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].iscsi.IFMarker = No
Nov 14 12:53:39 user nova-compute[75258]: node.conn[0].iscsi.OFMarker = No
Nov 14 12:53:39 user nova-compute[75258]: # END RECORD
Nov 14 12:53:39 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5d151a-3708-4b3b-ace5-4c649529ce9e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[964ef054-24c8-4639-8563-ea14a5b9fe65]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYfwBJGa {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v DYfwBJGa" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[767d3119-3a11-487d-b756-5cdeebe52622]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'DYfwBJGa'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27189bb9-d84b-4b4b-9c61-53f649e5e654]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d620827-4acb-4ef3-8a02-f18e12447da4]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:39 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:39 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:39 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:39 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:39 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:39 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:39 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:39 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.158s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] HCTL ('36', '0', '0', 0) found on session 45 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edd36d9-c383-41a6-ae64-6a1810c4f82b]: (4, ('0 0 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Searching for a device in session 45 and hctl ('36', '0', '0', 0) yield: sde {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYfwBJGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.180s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] <== connect_volume: return (181ms) {'type': 'block', 'scsi_wwn': '23739343939636330', 'path': '/dev/sde'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23739343939636330', 'path': '/dev/sde'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-310526585',display_name='tempest-ServerStableDeviceRescueTest-server-310526585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-310526585',id=28,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG2e4IB1za5Z+ErNPEkFDOSfaS97gX1KNSyYOquhPEa3PIidS2htvR8u3/MpC6Vg9o03CK36r386GijlvYb+EV9lJrjPsoT4y415VdDfbaJlxwPmUQILxfjzOis/P4JIA==',key_name='tempest-keypair-1454761844',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:49:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ad4523c046417ba2124dce941487fa',ramdisk_id='',reservation_id='r-i2f82awa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-935137255',owner_user_name='tempest-ServerStableDeviceRescueTest-935137255-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:51:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4a59da80f249b891b10a581146f0dd',uuid=94a7efee-d97e-4638-a2d7-2c526a0bc148,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "vif_mac": "fa:16:3e:63:41:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converting VIF {"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "vif_mac": "fa:16:3e:63:41:94"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'pci_devices' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.objects.base [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Object Instance<94a7efee-d97e-4638-a2d7-2c526a0bc148> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:53:39 user nova-compute[75258]:   <uuid>94a7efee-d97e-4638-a2d7-2c526a0bc148</uuid>
Nov 14 12:53:39 user nova-compute[75258]:   <name>instance-0000001c</name>
Nov 14 12:53:39 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:53:39 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:53:39 user nova-compute[75258]:   <metadata>
Nov 14 12:53:39 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:53:39 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:53:39 user nova-compute[75258]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-310526585</nova:name>
Nov 14 12:53:39 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:53:38</nova:creationTime>
Nov 14 12:53:39 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:53:39 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:53:39 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:53:39 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:53:39 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:53:39 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:53:39 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:53:39 user nova-compute[75258]:       <nova:owner>
Nov 14 12:53:39 user nova-compute[75258]:         <nova:user uuid="ff4a59da80f249b891b10a581146f0dd">tempest-ServerStableDeviceRescueTest-935137255-project-member</nova:user>
Nov 14 12:53:39 user nova-compute[75258]:         <nova:project uuid="04ad4523c046417ba2124dce941487fa">tempest-ServerStableDeviceRescueTest-935137255</nova:project>
Nov 14 12:53:39 user nova-compute[75258]:       </nova:owner>
Nov 14 12:53:39 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:53:39 user nova-compute[75258]:       <nova:ports>
Nov 14 12:53:39 user nova-compute[75258]:         <nova:port uuid="0f4ff176-a93c-4da3-97d1-a4bbf3de403a">
Nov 14 12:53:39 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 12:53:39 user nova-compute[75258]:         </nova:port>
Nov 14 12:53:39 user nova-compute[75258]:       </nova:ports>
Nov 14 12:53:39 user nova-compute[75258]:     </nova:instance>
Nov 14 12:53:39 user nova-compute[75258]:   </metadata>
Nov 14 12:53:39 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:53:39 user nova-compute[75258]:     <system>
Nov 14 12:53:39 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:53:39 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:53:39 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:53:39 user nova-compute[75258]:       <entry name="serial">94a7efee-d97e-4638-a2d7-2c526a0bc148</entry>
Nov 14 12:53:39 user nova-compute[75258]:       <entry name="uuid">94a7efee-d97e-4638-a2d7-2c526a0bc148</entry>
Nov 14 12:53:39 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:53:39 user nova-compute[75258]:     </system>
Nov 14 12:53:39 user nova-compute[75258]:   </sysinfo>
Nov 14 12:53:39 user nova-compute[75258]:   <os>
Nov 14 12:53:39 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:53:39 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:53:39 user nova-compute[75258]:   </os>
Nov 14 12:53:39 user nova-compute[75258]:   <features>
Nov 14 12:53:39 user nova-compute[75258]:     <acpi/>
Nov 14 12:53:39 user nova-compute[75258]:     <apic/>
Nov 14 12:53:39 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:53:39 user nova-compute[75258]:   </features>
Nov 14 12:53:39 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:53:39 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:53:39 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:53:39 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:53:39 user nova-compute[75258]:   </clock>
Nov 14 12:53:39 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:53:39 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:53:39 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:53:39 user nova-compute[75258]:   </cpu>
Nov 14 12:53:39 user nova-compute[75258]:   <devices>
Nov 14 12:53:39 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:53:39 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:53:39 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk"/>
Nov 14 12:53:39 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:53:39 user nova-compute[75258]:     </disk>
Nov 14 12:53:39 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:53:39 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:53:39 user nova-compute[75258]:       <source dev="/dev/sde"/>
Nov 14 12:53:39 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 12:53:39 user nova-compute[75258]:       <serial>048e2e04-0357-4ab7-a6c6-c696a383f4a5</serial>
Nov 14 12:53:39 user nova-compute[75258]:     </disk>
Nov 14 12:53:39 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:53:39 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:53:39 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue"/>
Nov 14 12:53:39 user nova-compute[75258]:       <target dev="vdc" bus="virtio"/>
Nov 14 12:53:39 user nova-compute[75258]:       <boot order="1"/>
Nov 14 12:53:39 user nova-compute[75258]:     </disk>
Nov 14 12:53:39 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:53:39 user nova-compute[75258]:       <mac address="fa:16:3e:63:41:94"/>
Nov 14 12:53:39 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:53:39 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:53:39 user nova-compute[75258]:       <target dev="tap0f4ff176-a9"/>
Nov 14 12:53:39 user nova-compute[75258]:     </interface>
Nov 14 12:53:39 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:53:39 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/console.log" append="off"/>
Nov 14 12:53:39 user nova-compute[75258]:     </serial>
Nov 14 12:53:39 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:53:39 user nova-compute[75258]:     <video>
Nov 14 12:53:39 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:53:39 user nova-compute[75258]:     </video>
Nov 14 12:53:39 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:53:39 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:53:39 user nova-compute[75258]:     </rng>
Nov 14 12:53:39 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:53:39 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:53:39 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:53:39 user nova-compute[75258]:     </memballoon>
Nov 14 12:53:39 user nova-compute[75258]:   </devices>
Nov 14 12:53:39 user nova-compute[75258]: </domain>
Nov 14 12:53:39 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:53:39 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance destroyed successfully.
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] No VIF found with MAC fa:16:3e:63:41:94, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:53:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-02cd2199-a58d-45ad-ad4d-6df16371f0d1 req-87e416dd-355e-493b-b3cc-c4c1a738fff5 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-02cd2199-a58d-45ad-ad4d-6df16371f0d1 req-87e416dd-355e-493b-b3cc-c4c1a738fff5 service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-02cd2199-a58d-45ad-ad4d-6df16371f0d1 req-87e416dd-355e-493b-b3cc-c4c1a738fff5 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-02cd2199-a58d-45ad-ad4d-6df16371f0d1 req-87e416dd-355e-493b-b3cc-c4c1a738fff5 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-02cd2199-a58d-45ad-ad4d-6df16371f0d1 req-87e416dd-355e-493b-b3cc-c4c1a738fff5 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:40 user nova-compute[75258]: WARNING nova.compute.manager [req-02cd2199-a58d-45ad-ad4d-6df16371f0d1 req-87e416dd-355e-493b-b3cc-c4c1a738fff5 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state active and task_state rescuing.
Nov 14 12:53:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-9be25e63-0f53-4022-83cd-67378baafd1e tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:53:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-3bd87c88-7230-43f8-b97e-69007c7dc415 req-0327968c-9f53-4ab8-aa5a-dddec20f49fb service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3bd87c88-7230-43f8-b97e-69007c7dc415 req-0327968c-9f53-4ab8-aa5a-dddec20f49fb service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3bd87c88-7230-43f8-b97e-69007c7dc415 req-0327968c-9f53-4ab8-aa5a-dddec20f49fb service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3bd87c88-7230-43f8-b97e-69007c7dc415 req-0327968c-9f53-4ab8-aa5a-dddec20f49fb service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-3bd87c88-7230-43f8-b97e-69007c7dc415 req-0327968c-9f53-4ab8-aa5a-dddec20f49fb service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:42 user nova-compute[75258]: WARNING nova.compute.manager [req-3bd87c88-7230-43f8-b97e-69007c7dc415 req-0327968c-9f53-4ab8-aa5a-dddec20f49fb service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state active and task_state rescuing.
Nov 14 12:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:53:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:53:47 user nova-compute[75258]: INFO nova.compute.claims [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Claim successful on node user
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.395s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:53:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.policy [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '974df2b5a20f414eadb9e84383523e4f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a6dc8f5ff4bf4a4788a2f7ec14b844f5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:53:48 user nova-compute[75258]: INFO nova.virt.block_device [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Booting with volume 10da2cc0-95ea-4f88-83ef-2db5d629e03d at /dev/vda
Nov 14 12:53:48 user nova-compute[75258]: DEBUG os_brick.utils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee111815-e1df-48dc-a626-667accc3e2dd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2cc59cb-d293-4590-88eb-23bd2af8e276]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b15375-b6c7-44e9-8880-bf3a84c819d8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b14213-07ca-4223-bc49-9a4b1982c721]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:48 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:53:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a484692-c46f-4e6a-b3fc-5c77aa6fb5ee]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG os_brick.utils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating existing volume attachment record: 112decb8-c9e7-4c27-81d9-66ecbc0ac742 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:53:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Successfully created port: 1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Successfully updated port: 1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquired lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-changed-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Refreshing instance network info cache due to event network-changed-1db3ef49-8294-4f19-95a7-6499221f589a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] Acquiring lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Releasing lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance network_info: |[{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] Acquired lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Refreshing network info cache for port 1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:53:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updated VIF entry in instance network info cache for port 1db3ef49-8294-4f19-95a7-6499221f589a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:53:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-28fb0104-4582-4a6f-a2dc-016b24d06c96 req-39fb59e4-e32e-4294-b4c0-8c0a86ff7de0 service nova] Releasing lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-changed-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Refreshing instance network info cache due to event network-changed-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] Acquiring lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] Acquired lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Refreshing network info cache for port f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updated VIF entry in instance network info cache for port f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updating instance_info_cache with network_info: [{"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b574cd89-420b-4734-b8a1-221cf011d822 req-55f8d186-340b-46d9-93aa-6b8d7d715d9a service nova] Releasing lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'flavor' on Instance uuid 655df082-9b52-4bf6-8de5-e98f500e7454 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:52 user nova-compute[75258]: INFO nova.compute.manager [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Attaching volume b2f90485-9d5e-4cbd-997d-2e70684daaf9 to /dev/vdb
Nov 14 12:53:52 user nova-compute[75258]: DEBUG os_brick.utils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0d7743b-452f-463c-bda9-b574e4d8658a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8ff54f-206e-46ed-b598-6446f2e03497]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f90c915-37c7-459b-99f2-172ddd9e7c04]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a0be0ec-8f74-40f5-a739-cb1006b25c05]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:53:52 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:53:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85184f3-9b3e-4530-993a-969c6dec6f26]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG os_brick.utils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] <== get_connector_properties: return (145ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:52 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updating existing volume attachment record: 70a96a35-6de6-4715-96d2-779a186017a8 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:53:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Creating image(s)
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Ensure instance console log exists: /opt/stack/data/nova/instances/a7b11d71-ee0a-47e0-a1e2-2206f0be1b46/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Start _get_guest_xml network_info=[{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a7b11d71-ee0a-47e0-a1e2-2206f0be1b46', 'attached_at': '', 'detached_at': '', 'volume_id': '10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'serial': '10da2cc0-95ea-4f88-83ef-2db5d629e03d'}, 'device_type': 'disk', 'attachment_id': '112decb8-c9e7-4c27-81d9-66ecbc0ac742', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:53:53 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:53:53 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:53 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:53 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:53 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de1b4222-fb73-4ffe-8485-b5599ad42736]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:53:53 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda2139b-adf1-40ce-9bc0-41235ed5e471]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d] added
Nov 14 12:53:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c38cb96-a662-44a4-899e-024a73d5a622]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ede77d-8f3f-4c5d-9330-7630d1a4f0f3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDgjuYO {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDgjuYO" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ea4f82-975b-45f0-a431-478e7c719d57]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzDgjuYO'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d028cb-2e05-4780-a9a5-ea9b5a723674]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bea72a-2dde-4a44-8af0-7b1f891143a6]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fbe371d-e11d-439f-b73a-3d321ed1a357]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]
Nov 14 12:53:53 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.
Nov 14 12:53:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4d6d806-9136-41ac-be04-6f01666e8b31]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2aaaf48-1383-492f-82b5-08f871dd835f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:53:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:53 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:53:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.299s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] HCTL ('37', '-', '-', 0) found on session 46 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3ecbf-a556-4c97-ad46-8a3954df8a73]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching for a device in session 46 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:53:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.332s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26464636331353636', 'path': '/dev/sdf'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464636331353636', 'path': '/dev/sdf'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-249838839',display_name='tempest-ServerActionsTestOtherA-server-249838839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-249838839',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-cgmyb0n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=a7b11d71-ee0a-47e0-a1e2-2206f0be1b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.objects.instance [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'pci_devices' on Instance uuid a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:53:54 user nova-compute[75258]:   <uuid>a7b11d71-ee0a-47e0-a1e2-2206f0be1b46</uuid>
Nov 14 12:53:54 user nova-compute[75258]:   <name>instance-00000021</name>
Nov 14 12:53:54 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:53:54 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:53:54 user nova-compute[75258]:   <metadata>
Nov 14 12:53:54 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:53:54 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:53:54 user nova-compute[75258]:       <nova:name>tempest-ServerActionsTestOtherA-server-249838839</nova:name>
Nov 14 12:53:54 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:53:53</nova:creationTime>
Nov 14 12:53:54 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:53:54 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:53:54 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:53:54 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:53:54 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:53:54 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:53:54 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:53:54 user nova-compute[75258]:       <nova:owner>
Nov 14 12:53:54 user nova-compute[75258]:         <nova:user uuid="974df2b5a20f414eadb9e84383523e4f">tempest-ServerActionsTestOtherA-1553354563-project-member</nova:user>
Nov 14 12:53:54 user nova-compute[75258]:         <nova:project uuid="a6dc8f5ff4bf4a4788a2f7ec14b844f5">tempest-ServerActionsTestOtherA-1553354563</nova:project>
Nov 14 12:53:54 user nova-compute[75258]:       </nova:owner>
Nov 14 12:53:54 user nova-compute[75258]:       <nova:ports>
Nov 14 12:53:54 user nova-compute[75258]:         <nova:port uuid="1db3ef49-8294-4f19-95a7-6499221f589a">
Nov 14 12:53:54 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 12:53:54 user nova-compute[75258]:         </nova:port>
Nov 14 12:53:54 user nova-compute[75258]:       </nova:ports>
Nov 14 12:53:54 user nova-compute[75258]:     </nova:instance>
Nov 14 12:53:54 user nova-compute[75258]:   </metadata>
Nov 14 12:53:54 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:53:54 user nova-compute[75258]:     <system>
Nov 14 12:53:54 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:53:54 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:53:54 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:53:54 user nova-compute[75258]:       <entry name="serial">a7b11d71-ee0a-47e0-a1e2-2206f0be1b46</entry>
Nov 14 12:53:54 user nova-compute[75258]:       <entry name="uuid">a7b11d71-ee0a-47e0-a1e2-2206f0be1b46</entry>
Nov 14 12:53:54 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:53:54 user nova-compute[75258]:     </system>
Nov 14 12:53:54 user nova-compute[75258]:   </sysinfo>
Nov 14 12:53:54 user nova-compute[75258]:   <os>
Nov 14 12:53:54 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:53:54 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:53:54 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:53:54 user nova-compute[75258]:   </os>
Nov 14 12:53:54 user nova-compute[75258]:   <features>
Nov 14 12:53:54 user nova-compute[75258]:     <acpi/>
Nov 14 12:53:54 user nova-compute[75258]:     <apic/>
Nov 14 12:53:54 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:53:54 user nova-compute[75258]:   </features>
Nov 14 12:53:54 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:53:54 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:53:54 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:53:54 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:53:54 user nova-compute[75258]:   </clock>
Nov 14 12:53:54 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:53:54 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:53:54 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:53:54 user nova-compute[75258]:   </cpu>
Nov 14 12:53:54 user nova-compute[75258]:   <devices>
Nov 14 12:53:54 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:53:54 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:53:54 user nova-compute[75258]:       <source dev="/dev/sdf"/>
Nov 14 12:53:54 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:53:54 user nova-compute[75258]:       <serial>10da2cc0-95ea-4f88-83ef-2db5d629e03d</serial>
Nov 14 12:53:54 user nova-compute[75258]:     </disk>
Nov 14 12:53:54 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:53:54 user nova-compute[75258]:       <mac address="fa:16:3e:cd:67:df"/>
Nov 14 12:53:54 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:53:54 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:53:54 user nova-compute[75258]:       <target dev="tap1db3ef49-82"/>
Nov 14 12:53:54 user nova-compute[75258]:     </interface>
Nov 14 12:53:54 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:53:54 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/a7b11d71-ee0a-47e0-a1e2-2206f0be1b46/console.log" append="off"/>
Nov 14 12:53:54 user nova-compute[75258]:     </serial>
Nov 14 12:53:54 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:53:54 user nova-compute[75258]:     <video>
Nov 14 12:53:54 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:53:54 user nova-compute[75258]:     </video>
Nov 14 12:53:54 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:53:54 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:53:54 user nova-compute[75258]:     </rng>
Nov 14 12:53:54 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:53:54 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:53:54 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:53:54 user nova-compute[75258]:     </memballoon>
Nov 14 12:53:54 user nova-compute[75258]:   </devices>
Nov 14 12:53:54 user nova-compute[75258]: </domain>
Nov 14 12:53:54 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-249838839',display_name='tempest-ServerActionsTestOtherA-server-249838839',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-249838839',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-cgmyb0n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:53:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=a7b11d71-ee0a-47e0-a1e2-2206f0be1b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG os_vif [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf3d6eb9-0a5f-599e-8986-40fca881a0d4', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db3ef49-82, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1db3ef49-82, col_values=(('qos', UUID('56ef70b6-940a-4a63-a95a-64d3eefb852e')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1db3ef49-82, col_values=(('external_ids', {'iface-id': '1db3ef49-8294-4f19-95a7-6499221f589a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:67:df', 'vm-uuid': 'a7b11d71-ee0a-47e0-a1e2-2206f0be1b46'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: INFO os_vif [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82')
Nov 14 12:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No VIF found with MAC fa:16:3e:cd:67:df, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:53:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-736ce3b7-932a-42f9-bdda-ce82b54a9675 req-05566a96-41a5-475d-a288-f32c77aea753 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-736ce3b7-932a-42f9-bdda-ce82b54a9675 req-05566a96-41a5-475d-a288-f32c77aea753 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-736ce3b7-932a-42f9-bdda-ce82b54a9675 req-05566a96-41a5-475d-a288-f32c77aea753 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-736ce3b7-932a-42f9-bdda-ce82b54a9675 req-05566a96-41a5-475d-a288-f32c77aea753 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-736ce3b7-932a-42f9-bdda-ce82b54a9675 req-05566a96-41a5-475d-a288-f32c77aea753 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:56 user nova-compute[75258]: WARNING nova.compute.manager [req-736ce3b7-932a-42f9-bdda-ce82b54a9675 req-05566a96-41a5-475d-a288-f32c77aea753 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state building and task_state spawning.
Nov 14 12:53:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmMyoQPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:53:57 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:57 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:53:57 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[346aebb9-18d5-4710-855a-bacc8169b326]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:53:57 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[775acad6-09e7-411b-9e01-d9f8abff0dc4]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9] added
Nov 14 12:53:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e262481d-9a07-470f-bcd8-553cb567e93f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[081e38ca-fb1f-4483-971d-2d8801fe1e89]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmMyoQPN {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v zmMyoQPN" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9f5c55-adce-4d6c-8f82-48698b6b5a45]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'zmMyoQPN'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cc879c2-0f61-4ddb-84c5-0717af14b362]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a22cc10-7163-46d6-b500-1acba2a8810c]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:53:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:53:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57db6fc-fcf8-4990-a4f3-c722b9543010]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260]
Nov 14 12:53:57 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260] successful.
Nov 14 12:53:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d37575-d919-4d5d-a3c2-635d39689cf0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[62081e67-3c19-498d-80da-8ad890b30530]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:53:57 user nova-compute[75258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 (non-flash)
Nov 14 12:53:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.305s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] HCTL ('38', '-', '-', 0) found on session 47 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8136fe0c-d817-4f8b-822b-30353e2582b3]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Searching for a device in session 47 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:53:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmMyoQPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:53:58 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance spawned successfully.
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:53:58 user nova-compute[75258]: INFO nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Took 5.04 seconds to spawn the instance on the hypervisor.
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:53:58 user nova-compute[75258]: INFO nova.compute.manager [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Took 10.45 seconds to build instance.
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-17434387-ce6b-4602-bde8-de9490b09bbd req-e1e6edb3-6269-4a72-9c88-728d6e434d80 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-17434387-ce6b-4602-bde8-de9490b09bbd req-e1e6edb3-6269-4a72-9c88-728d6e434d80 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-17434387-ce6b-4602-bde8-de9490b09bbd req-e1e6edb3-6269-4a72-9c88-728d6e434d80 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-17434387-ce6b-4602-bde8-de9490b09bbd req-e1e6edb3-6269-4a72-9c88-728d6e434d80 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-17434387-ce6b-4602-bde8-de9490b09bbd req-e1e6edb3-6269-4a72-9c88-728d6e434d80 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:53:58 user nova-compute[75258]: WARNING nova.compute.manager [req-17434387-ce6b-4602-bde8-de9490b09bbd req-e1e6edb3-6269-4a72-9c88-728d6e434d80 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state None.
Nov 14 12:53:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-29aab3b0-93c3-4717-99a9-b0f2277f51b7 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.593s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.340s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] <== connect_volume: return (1342ms) {'type': 'block', 'scsi_wwn': '23935323562636236', 'path': '/dev/sdg'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23935323562636236', 'path': '/dev/sdg'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'flavor' on Instance uuid 655df082-9b52-4bf6-8de5-e98f500e7454 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:53:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:53:58 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:53:58 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:53:58 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:53:58 user nova-compute[75258]:   <serial>b2f90485-9d5e-4cbd-997d-2e70684daaf9</serial>
Nov 14 12:53:58 user nova-compute[75258]: </disk>
Nov 14 12:53:58 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:53:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:53:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No VIF found with MAC fa:16:3e:59:62:18, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:53:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5244d2a2-2804-4219-b4cd-4418e34419ec tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.570s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:53:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:53:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:02 user nova-compute[75258]: INFO nova.compute.manager [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Detaching volume b2f90485-9d5e-4cbd-997d-2e70684daaf9
Nov 14 12:54:02 user nova-compute[75258]: INFO nova.virt.block_device [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Attempting to driver detach volume b2f90485-9d5e-4cbd-997d-2e70684daaf9 from mountpoint /dev/vdb
Nov 14 12:54:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Attempting to detach device vdb from instance 655df082-9b52-4bf6-8de5-e98f500e7454 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:54:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:54:02 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:54:02 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:54:02 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:54:02 user nova-compute[75258]:   <serial>b2f90485-9d5e-4cbd-997d-2e70684daaf9</serial>
Nov 14 12:54:02 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:54:02 user nova-compute[75258]: </disk>
Nov 14 12:54:02 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:54:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully detached device vdb from instance 655df082-9b52-4bf6-8de5-e98f500e7454 from the persistent domain config.
Nov 14 12:54:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 655df082-9b52-4bf6-8de5-e98f500e7454 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:54:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:54:02 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:54:02 user nova-compute[75258]:   <source dev="/dev/sdg"/>
Nov 14 12:54:02 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:54:02 user nova-compute[75258]:   <serial>b2f90485-9d5e-4cbd-997d-2e70684daaf9</serial>
Nov 14 12:54:02 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:54:02 user nova-compute[75258]: </disk>
Nov 14 12:54:02 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:54:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 655df082-9b52-4bf6-8de5-e98f500e7454 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:04 user nova-compute[75258]: INFO nova.compute.manager [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Terminating instance
Nov 14 12:54:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-84202140-7f42-441a-8322-24d1ba122acb req-a3749be2-26a1-4f9e-92e8-5176cec5ac1f service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-unplugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-84202140-7f42-441a-8322-24d1ba122acb req-a3749be2-26a1-4f9e-92e8-5176cec5ac1f service nova] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-84202140-7f42-441a-8322-24d1ba122acb req-a3749be2-26a1-4f9e-92e8-5176cec5ac1f service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-84202140-7f42-441a-8322-24d1ba122acb req-a3749be2-26a1-4f9e-92e8-5176cec5ac1f service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-84202140-7f42-441a-8322-24d1ba122acb req-a3749be2-26a1-4f9e-92e8-5176cec5ac1f service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] No waiting events found dispatching network-vif-unplugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-84202140-7f42-441a-8322-24d1ba122acb req-a3749be2-26a1-4f9e-92e8-5176cec5ac1f service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-unplugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Instance destroyed successfully.
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'resources' on Instance uuid 9ddad9fb-2478-4c56-8522-afdc3b2b2632 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:44:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1647071446',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1647071446',id=22,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:44:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-p0i1i32o',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:46:39Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=9ddad9fb-2478-4c56-8522-afdc3b2b2632,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "address": "fa:16:3e:08:73:b9", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapecf2a47a-8c", "ovs_interfaceid": "ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:08:73:b9,bridge_name='br-int',has_traffic_filtering=True,id=ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf2a47a-8c') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG os_vif [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:73:b9,bridge_name='br-int',has_traffic_filtering=True,id=ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf2a47a-8c') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapecf2a47a-8c, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c8f6f33f-c2d1-4a62-815e-5bb9fed26cc2) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: INFO os_vif [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:08:73:b9,bridge_name='br-int',has_traffic_filtering=True,id=ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapecf2a47a-8c')
Nov 14 12:54:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Deleting instance files /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632_del
Nov 14 12:54:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Deletion of /opt/stack/data/nova/instances/9ddad9fb-2478-4c56-8522-afdc3b2b2632_del complete
Nov 14 12:54:05 user nova-compute[75258]: INFO nova.compute.manager [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Took 0.73 seconds to destroy the instance on the hypervisor.
Nov 14 12:54:05 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:06 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:54:06 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Took 0.52 seconds to deallocate network for instance.
Nov 14 12:54:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-a257b328-8ed8-43c3-9827-6160951513df req-82641afc-0a0f-4777-a6c9-e995e1a59059 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-deleted-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:06 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:54:06 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:54:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.315s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:06 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Deleted allocations for instance 9ddad9fb-2478-4c56-8522-afdc3b2b2632
Nov 14 12:54:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3b6ad485-913f-4a58-be1b-31287e3fa1e9 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.745s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] No waiting events found dispatching network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:07 user nova-compute[75258]: WARNING nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received unexpected event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c for instance with vm_state deleted and task_state None.
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] No waiting events found dispatching network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:07 user nova-compute[75258]: WARNING nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received unexpected event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c for instance with vm_state deleted and task_state None.
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] No waiting events found dispatching network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:07 user nova-compute[75258]: WARNING nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received unexpected event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c for instance with vm_state deleted and task_state None.
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Acquiring lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] Lock "9ddad9fb-2478-4c56-8522-afdc3b2b2632-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] No waiting events found dispatching network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:07 user nova-compute[75258]: WARNING nova.compute.manager [req-7347f45e-ed2c-466e-bd52-9faef6502c47 req-3875e57e-5cfc-445c-a6e3-bd1217028b28 service nova] [instance: 9ddad9fb-2478-4c56-8522-afdc3b2b2632] Received unexpected event network-vif-plugged-ecf2a47a-8cec-4e3b-b4bf-fdbbafb6b12c for instance with vm_state deleted and task_state None.
Nov 14 12:54:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [{"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-5cc80485-d82a-4cf9-856c-6594f6e37c7e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:54:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:54:22 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 655df082-9b52-4bf6-8de5-e98f500e7454 is timed out.
Nov 14 12:54:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully detached device vdb from instance 655df082-9b52-4bf6-8de5-e98f500e7454 from the live domain config.
Nov 14 12:54:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zmMyoQPN', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:54:22 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fde1122-4926-4e5d-aa41-6db6ef128430]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:54:22 user nova-compute[75258]: No targets found.
Nov 14 12:54:22 user nova-compute[75258]: iSNS:
Nov 14 12:54:22 user nova-compute[75258]: No targets found.
Nov 14 12:54:22 user nova-compute[75258]: STATIC:
Nov 14 12:54:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:54:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43
Nov 14 12:54:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9
Nov 14 12:54:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:54:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae
Nov 14 12:54:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:54:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:22 user nova-compute[75258]: FIRMWARE:
Nov 14 12:54:22 user nova-compute[75258]: No targets found.
Nov 14 12:54:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:54:22 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:54:22 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb878895-ff79-427d-8cde-4ee544ade4a9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f634bfb7-847c-4c3d-ad23-f8cdc4486a8a]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:54:22 user nova-compute[75258]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 (non-flash)
Nov 14 12:54:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7be200>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9'): ({'sdg'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Removing single pathed devices sdg {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c07a9f72-6140-42bb-a51a-8fb50cdd9341]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4a5eb73-c67b-4328-998c-f4aa980b0bde]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Flushing IO for device /dev/sdg {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02063356-4834-423e-8cfa-e91508ddb330]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:54:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.051s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c4146de-6a29-4373-a72d-31f6dda925dc]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] SCSI volumes sdg have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38b0ebf8-969f-440b-8ced-1636cb345433]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e73c3804-5ca4-47e5-8e2e-6725ca30154d]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260]
Nov 14 12:54:23 user nova-compute[75258]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9, portal: 172.16.0.220,3260] successful.
Nov 14 12:54:23 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b2f90485-9d5e-4cbd-997d-2e70684daaf9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f79d34-91a1-445a-b754-37848bacc9f3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.351s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] <== disconnect_volume: return (353ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'flavor' on Instance uuid 655df082-9b52-4bf6-8de5-e98f500e7454 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-47cb060a-24db-4f8f-888f-79e6f144c2c9 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.809s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:54:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:54:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=7840MB free_disk=24.884410858154297GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:54:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2c78427a-e54f-4763-be94-b8e20263c6d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 655df082-9b52-4bf6-8de5-e98f500e7454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4cf466fa-a8fd-4ad7-811e-414dab7b1e47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:54:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.460s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:54:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received event network-changed-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Refreshing instance network info cache due to event network-changed-a11a0db9-9ea7-46b9-b175-10a6bbe84661. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] Acquiring lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] Acquired lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG nova.network.neutron [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Refreshing network info cache for port a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG nova.network.neutron [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Updated VIF entry in instance network info cache for port a11a0db9-9ea7-46b9-b175-10a6bbe84661. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG nova.network.neutron [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Updating instance_info_cache with network_info: [{"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.161", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:54:39 user nova-compute[75258]: INFO nova.compute.manager [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Terminating instance
Nov 14 12:54:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3a089ff4-5e7f-4cf5-a652-ae5e84c3414c req-5ea158ca-1264-46b0-9e44-ae126bade97c service nova] Releasing lock "refresh_cache-4cf466fa-a8fd-4ad7-811e-414dab7b1e47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Instance destroyed successfully.
Nov 14 12:54:40 user nova-compute[75258]: DEBUG nova.objects.instance [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'resources' on Instance uuid 4cf466fa-a8fd-4ad7-811e-414dab7b1e47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:52:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-624431003',display_name='tempest-AttachVolumeNegativeTest-server-624431003',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-624431003',id=32,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFPOH+NFP7Yes/ATHX9d/uuC61/+uQ80J+Qm4Cwqdo7j+1PGAHgHlakkm6+NMDJNHj3bh/K/jvKZ+ootHo1uw57dBbMg3nIrvSgYxjVmbgtG9rA/YW6bZzQ+4eystDGHog==',key_name='tempest-keypair-1084487634',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:52:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-3o14uzme',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:52:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=4cf466fa-a8fd-4ad7-811e-414dab7b1e47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "address": "fa:16:3e:95:e1:20", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa11a0db9-9e", "ovs_interfaceid": "a11a0db9-9ea7-46b9-b175-10a6bbe84661", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:95:e1:20,bridge_name='br-int',has_traffic_filtering=True,id=a11a0db9-9ea7-46b9-b175-10a6bbe84661,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa11a0db9-9e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG os_vif [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e1:20,bridge_name='br-int',has_traffic_filtering=True,id=a11a0db9-9ea7-46b9-b175-10a6bbe84661,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa11a0db9-9e') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa11a0db9-9e, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=aeffa830-3f78-4920-bb00-903d4eb42ed0) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: INFO os_vif [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:95:e1:20,bridge_name='br-int',has_traffic_filtering=True,id=a11a0db9-9ea7-46b9-b175-10a6bbe84661,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa11a0db9-9e')
Nov 14 12:54:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Deleting instance files /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47_del
Nov 14 12:54:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Deletion of /opt/stack/data/nova/instances/4cf466fa-a8fd-4ad7-811e-414dab7b1e47_del complete
Nov 14 12:54:40 user nova-compute[75258]: INFO nova.compute.manager [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Took 0.87 seconds to destroy the instance on the hypervisor.
Nov 14 12:54:40 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:40 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:54:40 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Took 0.64 seconds to deallocate network for instance.
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received event network-vif-unplugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] No waiting events found dispatching network-vif-unplugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:41 user nova-compute[75258]: WARNING nova.compute.manager [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received unexpected event network-vif-unplugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 for instance with vm_state deleted and task_state None.
Nov 14 12:54:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received event network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] Acquiring lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] No waiting events found dispatching network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:41 user nova-compute[75258]: WARNING nova.compute.manager [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received unexpected event network-vif-plugged-a11a0db9-9ea7-46b9-b175-10a6bbe84661 for instance with vm_state deleted and task_state None.
Nov 14 12:54:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-8747d986-1c35-49a4-83ae-a12c48a65bb8 req-8b968248-7804-4cff-8ddc-df68b3724da2 service nova] [instance: 4cf466fa-a8fd-4ad7-811e-414dab7b1e47] Received event network-vif-deleted-a11a0db9-9ea7-46b9-b175-10a6bbe84661 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.286s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:41 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Deleted allocations for instance 4cf466fa-a8fd-4ad7-811e-414dab7b1e47
Nov 14 12:54:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-2bf2363e-e866-42a7-ae4e-8e53ccca690a tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "4cf466fa-a8fd-4ad7-811e-414dab7b1e47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.989s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:54:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:54:54 user nova-compute[75258]: INFO nova.compute.manager [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] instance snapshotting
Nov 14 12:54:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Beginning live snapshot process
Nov 14 12:54:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json -f qcow2" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json -f qcow2 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json -f qcow2" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphhv68w39/388ff3eef1244eebbb2f33205c791cce.delta 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmphhv68w39/388ff3eef1244eebbb2f33205c791cce.delta 1073741824" returned: 0 in 0.060s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:55 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Quiescing instance not available: QEMU guest agent is not enabled.
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:55 user nova-compute[75258]: INFO nova.compute.manager [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Terminating instance
Nov 14 12:54:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-b94a37ea-d4f8-4cd0-b502-083779bd61e8 req-0bc45e05-d52e-4909-a055-7935025a843d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b94a37ea-d4f8-4cd0-b502-083779bd61e8 req-0bc45e05-d52e-4909-a055-7935025a843d service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b94a37ea-d4f8-4cd0-b502-083779bd61e8 req-0bc45e05-d52e-4909-a055-7935025a843d service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b94a37ea-d4f8-4cd0-b502-083779bd61e8 req-0bc45e05-d52e-4909-a055-7935025a843d service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-b94a37ea-d4f8-4cd0-b502-083779bd61e8 req-0bc45e05-d52e-4909-a055-7935025a843d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-b94a37ea-d4f8-4cd0-b502-083779bd61e8 req-0bc45e05-d52e-4909-a055-7935025a843d service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Instance destroyed successfully.
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.objects.instance [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'resources' on Instance uuid 5cc80485-d82a-4cf9-856c-6594f6e37c7e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:39:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1141644014',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1141644014',id=13,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:41:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-vrhvg0r4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:42:56Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=5cc80485-d82a-4cf9-856c-6594f6e37c7e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "address": "fa:16:3e:f4:71:6f", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap12b52550-1a", "ovs_interfaceid": "12b52550-1a48-42c6-bd83-4241dd9e7e4e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_vif [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap12b52550-1a, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=83f64912-a391-4172-8448-004720aafda9) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: INFO os_vif [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f4:71:6f,bridge_name='br-int',has_traffic_filtering=True,id=12b52550-1a48-42c6-bd83-4241dd9e7e4e,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap12b52550-1a')
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OfclQLeh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:54:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=75258) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Nov 14 12:54:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Skipping quiescing instance: QEMU guest agent is not enabled.
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1b94c2b-49c6-4003-8bcd-dc9d630c4535]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:54:56 user nova-compute[75258]: No targets found.
Nov 14 12:54:56 user nova-compute[75258]: iSNS:
Nov 14 12:54:56 user nova-compute[75258]: No targets found.
Nov 14 12:54:56 user nova-compute[75258]: STATIC:
Nov 14 12:54:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132
Nov 14 12:54:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43
Nov 14 12:54:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:54:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae
Nov 14 12:54:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:54:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:54:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:54:56 user nova-compute[75258]: FIRMWARE:
Nov 14 12:54:56 user nova-compute[75258]: No targets found.
Nov 14 12:54:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:54:56 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:54:56 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a260bc1-6e56-400c-943a-99c5c696b475]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb96c919-af7e-44bc-82d7-754e6876796f]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:54:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:54:56 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:54:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4ac319f30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132'): ({'sdc'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Removing single pathed devices sdc {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[628e121a-0aac-4325-8d56-e6e90f416257]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphhv68w39/388ff3eef1244eebbb2f33205c791cce.delta /opt/stack/data/nova/instances/snapshots/tmphhv68w39/388ff3eef1244eebbb2f33205c791cce {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d0e0c0b-f263-4eb7-846f-a65aec0d7eca]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Flushing IO for device /dev/sdc {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baa33e6-bb36-4878-805e-58035a477259]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7bde0d-a50a-4ce6-9ded-6a5f81a073cc]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d6bcd57-200a-4fc2-b19d-3f28a4d7262f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:54:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --logout" returned: 0 in 0.116s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab2d854-5401-494d-9e4b-92823cf17502]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260]
Nov 14 12:54:57 user nova-compute[75258]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132, portal: 172.16.0.220,3260] successful.
Nov 14 12:54:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f6846ab5-9d42-4ade-baa2-ed961c7c0132 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[042b38ac-f0b3-4cff-9219-6d94871b4dfc]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.411s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] <== disconnect_volume: return (412ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:54:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Deleting instance files /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e_del
Nov 14 12:54:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Deletion of /opt/stack/data/nova/instances/5cc80485-d82a-4cf9-856c-6594f6e37c7e_del complete
Nov 14 12:54:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:54:57 user nova-compute[75258]: INFO nova.compute.manager [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Took 1.43 seconds to destroy the instance on the hypervisor.
Nov 14 12:54:57 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:54:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmphhv68w39/388ff3eef1244eebbb2f33205c791cce.delta /opt/stack/data/nova/instances/snapshots/tmphhv68w39/388ff3eef1244eebbb2f33205c791cce" returned: 0 in 0.547s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:54:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Snapshot extracted, beginning image upload
Nov 14 12:54:57 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:54:57 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Took 0.52 seconds to deallocate network for instance.
Nov 14 12:54:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-f29ed629-ff6f-4664-b94c-78d9df8c83c7 req-007cc806-4fa7-43f5-88a1-c2c980c633bf service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-deleted-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:58 user nova-compute[75258]: WARNING nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state deleting.
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:58 user nova-compute[75258]: WARNING nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state deleting.
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:58 user nova-compute[75258]: WARNING nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state deleting.
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-unplugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Acquiring lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] No waiting events found dispatching network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:54:58 user nova-compute[75258]: WARNING nova.compute.manager [req-849bd610-b033-4ac1-bb06-5872ec53f90d req-8d1d752f-210f-4e37-b828-15c59bfb56e0 service nova] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Received unexpected event network-vif-plugged-12b52550-1a48-42c6-bd83-4241dd9e7e4e for instance with vm_state active and task_state deleting.
Nov 14 12:54:58 user nova-compute[75258]: INFO nova.compute.manager [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 5cc80485-d82a-4cf9-856c-6594f6e37c7e] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.324s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:58 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Deleted allocations for instance 5cc80485-d82a-4cf9-856c-6594f6e37c7e
Nov 14 12:54:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-800db8fd-3a5b-47a3-afd9-3c4379f49df5 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "5cc80485-d82a-4cf9-856c-6594f6e37c7e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.174s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:54:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Snapshot image upload complete
Nov 14 12:54:59 user nova-compute[75258]: INFO nova.compute.manager [None req-2f42961b-0083-4909-b487-8da946d5abeb tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Took 5.07 seconds to snapshot the instance on the hypervisor.
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:55:01 user nova-compute[75258]: INFO nova.compute.claims [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Claim successful on node user
Nov 14 12:55:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.340s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:55:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.policy [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '24ce11c0aea848fcbe316b293ceecdf7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'abcfbbc31fe74017ba6be81499ff7592', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:55:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Creating image(s)
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "/opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "/opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "/opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Successfully created port: 7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.part --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.virt.images [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] e19729da-5aa4-42d1-9200-9a7692f675c4 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.part /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.part /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.converted" returned: 0 in 0.322s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Successfully updated port: 7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquired lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-changed-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.compute.manager [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Refreshing instance network info cache due to event network-changed-7cd0b4a2-0562-45c8-a9bf-23a3210f1506. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] Acquiring lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7.converted --force-share --output=json" returned: 0 in 0.201s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.716s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7 --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updating instance_info_cache with network_info: [{"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Releasing lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Instance network_info: |[{"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] Acquired lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG nova.network.neutron [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Refreshing network info cache for port 7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7 --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7,backing_fmt=raw /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7,backing_fmt=raw /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk 1073741824" returned: 0 in 0.047s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7 --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Ensure instance console log exists: /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Start _get_guest_xml network_info=[{"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='09b379ee174c1fb47d5733c03a95c1d6',container_format='bare',created_at=2023-11-14T12:54:54Z,direct_url=<?>,disk_format='qcow2',id=e19729da-5aa4-42d1-9200-9a7692f675c4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1683817033',owner='abcfbbc31fe74017ba6be81499ff7592',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T12:55:00Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'e19729da-5aa4-42d1-9200-9a7692f675c4'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:55:04 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:55:04 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='09b379ee174c1fb47d5733c03a95c1d6',container_format='bare',created_at=2023-11-14T12:54:54Z,direct_url=<?>,disk_format='qcow2',id=e19729da-5aa4-42d1-9200-9a7692f675c4,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-1683817033',owner='abcfbbc31fe74017ba6be81499ff7592',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-11-14T12:55:00Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-579689660',display_name='tempest-TestStampPattern-server-579689660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-579689660',id=34,image_ref='e19729da-5aa4-42d1-9200-9a7692f675c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jpfwPDiaw/GQ227J0mNoSTCU3OtL4gaaSJfLmw6zipgxzksWqHCtyLbWdzoVaIm0VPX7LvotObrlI//TM1p6iFvBovNg/Llgf/G+LW/rsG9r3i/SqUfLRUo5ZiUWfzQ==',key_name='tempest-TestStampPattern-1020160408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abcfbbc31fe74017ba6be81499ff7592',ramdisk_id='',reservation_id='r-k6mcd76n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='655df082-9b52-4bf6-8de5-e98f500e7454',image_min_disk='1',image_min_ram='0',image_owner_id='abcfbbc31fe74017ba6be81499ff7592',image_owner_project_name='tempest-TestStampPattern-253582314',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-253582314-project-member',image_user_id='24ce11c0aea848fcbe316b293ceecdf7',network_allocated='True',owner_project_name='tempest-TestStampPattern-253582314',owner_user_name='tempest-TestStampPattern-253582314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:55:02Z,user_data=None,user_id='24ce11c0aea848fcbe316b293ceecdf7',uuid=01f7b533-1825-4ea5-a580-7f6442e3630e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converting VIF {"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=7cd0b4a2-0562-45c8-a9bf-23a3210f1506,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd0b4a2-05') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'pci_devices' on Instance uuid 01f7b533-1825-4ea5-a580-7f6442e3630e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:55:04 user nova-compute[75258]:   <uuid>01f7b533-1825-4ea5-a580-7f6442e3630e</uuid>
Nov 14 12:55:04 user nova-compute[75258]:   <name>instance-00000022</name>
Nov 14 12:55:04 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:55:04 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:55:04 user nova-compute[75258]:   <metadata>
Nov 14 12:55:04 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:55:04 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:55:04 user nova-compute[75258]:       <nova:name>tempest-TestStampPattern-server-579689660</nova:name>
Nov 14 12:55:04 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:55:04</nova:creationTime>
Nov 14 12:55:04 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:55:04 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:55:04 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:55:04 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:55:04 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:55:04 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:55:04 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:55:04 user nova-compute[75258]:       <nova:owner>
Nov 14 12:55:04 user nova-compute[75258]:         <nova:user uuid="24ce11c0aea848fcbe316b293ceecdf7">tempest-TestStampPattern-253582314-project-member</nova:user>
Nov 14 12:55:04 user nova-compute[75258]:         <nova:project uuid="abcfbbc31fe74017ba6be81499ff7592">tempest-TestStampPattern-253582314</nova:project>
Nov 14 12:55:04 user nova-compute[75258]:       </nova:owner>
Nov 14 12:55:04 user nova-compute[75258]:       <nova:root type="image" uuid="e19729da-5aa4-42d1-9200-9a7692f675c4"/>
Nov 14 12:55:04 user nova-compute[75258]:       <nova:ports>
Nov 14 12:55:04 user nova-compute[75258]:         <nova:port uuid="7cd0b4a2-0562-45c8-a9bf-23a3210f1506">
Nov 14 12:55:04 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 12:55:04 user nova-compute[75258]:         </nova:port>
Nov 14 12:55:04 user nova-compute[75258]:       </nova:ports>
Nov 14 12:55:04 user nova-compute[75258]:     </nova:instance>
Nov 14 12:55:04 user nova-compute[75258]:   </metadata>
Nov 14 12:55:04 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:55:04 user nova-compute[75258]:     <system>
Nov 14 12:55:04 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:55:04 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:55:04 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:55:04 user nova-compute[75258]:       <entry name="serial">01f7b533-1825-4ea5-a580-7f6442e3630e</entry>
Nov 14 12:55:04 user nova-compute[75258]:       <entry name="uuid">01f7b533-1825-4ea5-a580-7f6442e3630e</entry>
Nov 14 12:55:04 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:55:04 user nova-compute[75258]:     </system>
Nov 14 12:55:04 user nova-compute[75258]:   </sysinfo>
Nov 14 12:55:04 user nova-compute[75258]:   <os>
Nov 14 12:55:04 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:55:04 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:55:04 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:55:04 user nova-compute[75258]:   </os>
Nov 14 12:55:04 user nova-compute[75258]:   <features>
Nov 14 12:55:04 user nova-compute[75258]:     <acpi/>
Nov 14 12:55:04 user nova-compute[75258]:     <apic/>
Nov 14 12:55:04 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:55:04 user nova-compute[75258]:   </features>
Nov 14 12:55:04 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:55:04 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:55:04 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:55:04 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:55:04 user nova-compute[75258]:   </clock>
Nov 14 12:55:04 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:55:04 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:55:04 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:55:04 user nova-compute[75258]:   </cpu>
Nov 14 12:55:04 user nova-compute[75258]:   <devices>
Nov 14 12:55:04 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:55:04 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:55:04 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk"/>
Nov 14 12:55:04 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:55:04 user nova-compute[75258]:     </disk>
Nov 14 12:55:04 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:55:04 user nova-compute[75258]:       <mac address="fa:16:3e:f2:c7:70"/>
Nov 14 12:55:04 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:55:04 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:55:04 user nova-compute[75258]:       <target dev="tap7cd0b4a2-05"/>
Nov 14 12:55:04 user nova-compute[75258]:     </interface>
Nov 14 12:55:04 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:55:04 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/console.log" append="off"/>
Nov 14 12:55:04 user nova-compute[75258]:     </serial>
Nov 14 12:55:04 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:55:04 user nova-compute[75258]:     <video>
Nov 14 12:55:04 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:55:04 user nova-compute[75258]:     </video>
Nov 14 12:55:04 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:55:04 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:55:04 user nova-compute[75258]:     </rng>
Nov 14 12:55:04 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:55:04 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:55:04 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:55:04 user nova-compute[75258]:     </memballoon>
Nov 14 12:55:04 user nova-compute[75258]:   </devices>
Nov 14 12:55:04 user nova-compute[75258]: </domain>
Nov 14 12:55:04 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-579689660',display_name='tempest-TestStampPattern-server-579689660',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-579689660',id=34,image_ref='e19729da-5aa4-42d1-9200-9a7692f675c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jpfwPDiaw/GQ227J0mNoSTCU3OtL4gaaSJfLmw6zipgxzksWqHCtyLbWdzoVaIm0VPX7LvotObrlI//TM1p6iFvBovNg/Llgf/G+LW/rsG9r3i/SqUfLRUo5ZiUWfzQ==',key_name='tempest-TestStampPattern-1020160408',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='abcfbbc31fe74017ba6be81499ff7592',ramdisk_id='',reservation_id='r-k6mcd76n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='655df082-9b52-4bf6-8de5-e98f500e7454',image_min_disk='1',image_min_ram='0',image_owner_id='abcfbbc31fe74017ba6be81499ff7592',image_owner_project_name='tempest-TestStampPattern-253582314',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-253582314-project-member',image_user_id='24ce11c0aea848fcbe316b293ceecdf7',network_allocated='True',owner_project_name='tempest-TestStampPattern-253582314',owner_user_name='tempest-TestStampPattern-253582314-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:55:02Z,user_data=None,user_id='24ce11c0aea848fcbe316b293ceecdf7',uuid=01f7b533-1825-4ea5-a580-7f6442e3630e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converting VIF {"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=7cd0b4a2-0562-45c8-a9bf-23a3210f1506,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd0b4a2-05') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG os_vif [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=7cd0b4a2-0562-45c8-a9bf-23a3210f1506,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd0b4a2-05') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd555553e-3057-51e1-a74c-53521f0b8c37', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7cd0b4a2-05, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7cd0b4a2-05, col_values=(('qos', UUID('d648198c-36f4-4d50-b587-b4832b73fa95')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7cd0b4a2-05, col_values=(('external_ids', {'iface-id': '7cd0b4a2-0562-45c8-a9bf-23a3210f1506', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:c7:70', 'vm-uuid': '01f7b533-1825-4ea5-a580-7f6442e3630e'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:04 user nova-compute[75258]: INFO os_vif [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=7cd0b4a2-0562-45c8-a9bf-23a3210f1506,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd0b4a2-05')
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No VIF found with MAC fa:16:3e:f2:c7:70, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.network.neutron [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updated VIF entry in instance network info cache for port 7cd0b4a2-0562-45c8-a9bf-23a3210f1506. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG nova.network.neutron [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updating instance_info_cache with network_info: [{"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2490c822-a6c0-4bb0-a396-eb25358f07f8 req-18c37ab7-5dc2-4401-8cf1-03337a6ab53d service nova] Releasing lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd3446d0-57f1-4231-8766-4337e4fcb83e req-b9ac4db4-cd42-4e8b-8354-9890f40f124d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd3446d0-57f1-4231-8766-4337e4fcb83e req-b9ac4db4-cd42-4e8b-8354-9890f40f124d service nova] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd3446d0-57f1-4231-8766-4337e4fcb83e req-b9ac4db4-cd42-4e8b-8354-9890f40f124d service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd3446d0-57f1-4231-8766-4337e4fcb83e req-b9ac4db4-cd42-4e8b-8354-9890f40f124d service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd3446d0-57f1-4231-8766-4337e4fcb83e req-b9ac4db4-cd42-4e8b-8354-9890f40f124d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] No waiting events found dispatching network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:05 user nova-compute[75258]: WARNING nova.compute.manager [req-bd3446d0-57f1-4231-8766-4337e4fcb83e req-b9ac4db4-cd42-4e8b-8354-9890f40f124d service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received unexpected event network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 for instance with vm_state building and task_state spawning.
Nov 14 12:55:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:55:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Instance spawned successfully.
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:55:07 user nova-compute[75258]: INFO nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Took 5.99 seconds to spawn the instance on the hypervisor.
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7bedccaa-07d7-42e8-a58a-aacc6a209936 req-8d63390d-cea5-4fa7-a9cd-411394c57b76 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7bedccaa-07d7-42e8-a58a-aacc6a209936 req-8d63390d-cea5-4fa7-a9cd-411394c57b76 service nova] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7bedccaa-07d7-42e8-a58a-aacc6a209936 req-8d63390d-cea5-4fa7-a9cd-411394c57b76 service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7bedccaa-07d7-42e8-a58a-aacc6a209936 req-8d63390d-cea5-4fa7-a9cd-411394c57b76 service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-7bedccaa-07d7-42e8-a58a-aacc6a209936 req-8d63390d-cea5-4fa7-a9cd-411394c57b76 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] No waiting events found dispatching network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:07 user nova-compute[75258]: WARNING nova.compute.manager [req-7bedccaa-07d7-42e8-a58a-aacc6a209936 req-8d63390d-cea5-4fa7-a9cd-411394c57b76 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received unexpected event network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 for instance with vm_state building and task_state spawning.
Nov 14 12:55:07 user nova-compute[75258]: INFO nova.compute.manager [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Took 6.66 seconds to build instance.
Nov 14 12:55:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ba0debc9-292e-4611-8a59-18b6a2cd35b5 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.754s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing instance network info cache due to event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:55:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] Acquiring lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] Acquired lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:55:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updated VIF entry in instance network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:55:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.210", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b9af2d14-dd1b-4b44-b4c2-0cbc2c24a2ee req-43ae32dd-9c6d-49cc-ae0c-adf6ff97edc0 service nova] Releasing lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:17 user nova-compute[75258]: INFO nova.compute.manager [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Detaching volume 4ba618c2-9c7d-4f49-a3d2-4e8760a356ae
Nov 14 12:55:18 user nova-compute[75258]: INFO nova.virt.block_device [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Attempting to driver detach volume 4ba618c2-9c7d-4f49-a3d2-4e8760a356ae from mountpoint /dev/vdb
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Attempting to detach device vdb from instance 2c78427a-e54f-4763-be94-b8e20263c6d9 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:55:18 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:55:18 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:55:18 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:55:18 user nova-compute[75258]:   <serial>4ba618c2-9c7d-4f49-a3d2-4e8760a356ae</serial>
Nov 14 12:55:18 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:55:18 user nova-compute[75258]: </disk>
Nov 14 12:55:18 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:55:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully detached device vdb from instance 2c78427a-e54f-4763-be94-b8e20263c6d9 from the persistent domain config.
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 2c78427a-e54f-4763-be94-b8e20263c6d9 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:55:18 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:55:18 user nova-compute[75258]:   <source dev="/dev/sdd"/>
Nov 14 12:55:18 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:55:18 user nova-compute[75258]:   <serial>4ba618c2-9c7d-4f49-a3d2-4e8760a356ae</serial>
Nov 14 12:55:18 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:55:18 user nova-compute[75258]: </disk>
Nov 14 12:55:18 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 2c78427a-e54f-4763-be94-b8e20263c6d9 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing instance network info cache due to event network-changed-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] Acquiring lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] Acquired lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Refreshing network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updated VIF entry in instance network info cache for port 6d604cf0-6140-43b3-a2b0-8d4ab2b77cda. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [{"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-06191862-5c3a-4b53-91ef-01eaf6729fcd req-c7e2840a-c70b-4176-abb4-536e793802ca service nova] Releasing lock "refresh_cache-2c78427a-e54f-4763-be94-b8e20263c6d9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:55:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.216s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:26 user nova-compute[75258]: INFO nova.compute.manager [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Unrescuing
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'flavor' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-ee5d26e3-db5d-4131-84ef-86ebf54f48c8 req-1a20760f-f6c3-4dbf-91cb-7f9c83bda2f1 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ee5d26e3-db5d-4131-84ef-86ebf54f48c8 req-1a20760f-f6c3-4dbf-91cb-7f9c83bda2f1 service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ee5d26e3-db5d-4131-84ef-86ebf54f48c8 req-1a20760f-f6c3-4dbf-91cb-7f9c83bda2f1 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ee5d26e3-db5d-4131-84ef-86ebf54f48c8 req-1a20760f-f6c3-4dbf-91cb-7f9c83bda2f1 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-ee5d26e3-db5d-4131-84ef-86ebf54f48c8 req-1a20760f-f6c3-4dbf-91cb-7f9c83bda2f1 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:27 user nova-compute[75258]: WARNING nova.compute.manager [req-ee5d26e3-db5d-4131-84ef-86ebf54f48c8 req-1a20760f-f6c3-4dbf-91cb-7f9c83bda2f1 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance destroyed successfully.
Nov 14 12:55:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:55:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8012MB free_disk=24.765735626220703GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2c78427a-e54f-4763-be94-b8e20263c6d9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 655df082-9b52-4bf6-8de5-e98f500e7454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 01f7b533-1825-4ea5-a580-7f6442e3630e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing instance network info cache due to event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.458s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updated VIF entry in instance network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing instance network info cache due to event network-changed-0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Refreshing network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updated VIF entry in instance network info cache for port 0f4ff176-a93c-4da3-97d1-a4bbf3de403a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:30 user nova-compute[75258]: WARNING nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:30 user nova-compute[75258]: WARNING nova.compute.manager [req-baa6defb-0838-454d-b452-aea07b4fef5b req-59067195-3ccf-4d06-8e93-dedd3c5e5890 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state rescued and task_state unrescuing.
Nov 14 12:55:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:31 user nova-compute[75258]: INFO nova.compute.manager [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Detaching volume d8803b6b-6006-4444-8a1b-ee5ff8a98e43
Nov 14 12:55:31 user nova-compute[75258]: INFO nova.virt.block_device [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Attempting to driver detach volume d8803b6b-6006-4444-8a1b-ee5ff8a98e43 from mountpoint /dev/vdb
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Attempting to detach device vdb from instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:55:31 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:55:31 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:55:31 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:55:31 user nova-compute[75258]:   <serial>d8803b6b-6006-4444-8a1b-ee5ff8a98e43</serial>
Nov 14 12:55:31 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:55:31 user nova-compute[75258]: </disk>
Nov 14 12:55:31 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:55:31 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully detached device vdb from instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c from the persistent domain config.
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:55:31 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:55:31 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:55:31 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:55:31 user nova-compute[75258]:   <serial>d8803b6b-6006-4444-8a1b-ee5ff8a98e43</serial>
Nov 14 12:55:31 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:55:31 user nova-compute[75258]: </disk>
Nov 14 12:55:31 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ef1c1a6d-b6aa-409d-9a8a-9ea2fd4fa2dd tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9e2d15a-a7c8-4818-a5af-96932cd9a8a8 req-1b69f19a-0141-4d4b-8215-ee682ee607f8 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9e2d15a-a7c8-4818-a5af-96932cd9a8a8 req-1b69f19a-0141-4d4b-8215-ee682ee607f8 service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9e2d15a-a7c8-4818-a5af-96932cd9a8a8 req-1b69f19a-0141-4d4b-8215-ee682ee607f8 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f9e2d15a-a7c8-4818-a5af-96932cd9a8a8 req-1b69f19a-0141-4d4b-8215-ee682ee607f8 service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-f9e2d15a-a7c8-4818-a5af-96932cd9a8a8 req-1b69f19a-0141-4d4b-8215-ee682ee607f8 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:31 user nova-compute[75258]: WARNING nova.compute.manager [req-f9e2d15a-a7c8-4818-a5af-96932cd9a8a8 req-1b69f19a-0141-4d4b-8215-ee682ee607f8 service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state active and task_state None.
Nov 14 12:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:38 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 2c78427a-e54f-4763-be94-b8e20263c6d9 is timed out.
Nov 14 12:55:38 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully detached device vdb from instance 2c78427a-e54f-4763-be94-b8e20263c6d9 from the live domain config.
Nov 14 12:55:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'zrsSIKMG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:55:38 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ed1d05e-3172-4bbe-8b82-7cc68419b229]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:55:38 user nova-compute[75258]: No targets found.
Nov 14 12:55:38 user nova-compute[75258]: iSNS:
Nov 14 12:55:38 user nova-compute[75258]: No targets found.
Nov 14 12:55:38 user nova-compute[75258]: STATIC:
Nov 14 12:55:38 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43
Nov 14 12:55:38 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:38 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:38 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:55:38 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:38 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:38 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae
Nov 14 12:55:38 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:38 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:38 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:55:38 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:38 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:38 user nova-compute[75258]: FIRMWARE:
Nov 14 12:55:38 user nova-compute[75258]: No targets found.
Nov 14 12:55:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:55:38 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:55:38 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b0ea251-53e0-4e93-b2b0-437a2a2d24f7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b974d3d2-c186-46df-bcb0-b0c0a713e421]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:38 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:55:38 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:38 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:38 user nova-compute[75258]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae (non-flash)
Nov 14 12:55:38 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:38 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c608a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae'): ({'sdd'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Removing single pathed devices sdd {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-changed-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Refreshing instance network info cache due to event network-changed-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] Acquiring lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] Acquired lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Refreshing network info cache for port 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb12df5-a244-429c-b3f0-9d4e7e9ad484]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0bf2ae4-45d6-4f95-8e55-4ebd1ebab291]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Flushing IO for device /dev/sdd {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51401095-fb60-42da-b040-591444380273]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.035s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b783ea0-dac7-4665-84ba-cbe14dcb7759]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] SCSI volumes sdd have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b034914-75a2-4190-a46b-99fa534e2089]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0840bc2e-5625-4a7f-962b-a9b4312fdbc5]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260]
Nov 14 12:55:38 user nova-compute[75258]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae, portal: 172.16.0.220,3260] successful.
Nov 14 12:55:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba618c2-9c7d-4f49-a3d2-4e8760a356ae -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e9ddc2-a586-435b-92e3-3f96779feb0a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.330s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] <== disconnect_volume: return (331ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updated VIF entry in instance network info cache for port 7b7400d1-ea22-4c63-8d3d-f4040b0eca9d. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:55:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-85eec71a-12c6-470a-b5bd-c372ee46c73e req-c3c04e9e-7b14-487f-a14e-a31d6a5177d0 service nova] Releasing lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:39 user nova-compute[75258]: DEBUG nova.objects.instance [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'flavor' on Instance uuid 2c78427a-e54f-4763-be94-b8e20263c6d9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:55:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-79daecb1-ac75-40d6-81d2-c5f11ec4d772 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.730s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Stashing vm_state: active {{(pid=75258) _prep_resize /opt/stack/nova/nova/compute/manager.py:5615}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:55:40 user nova-compute[75258]: INFO nova.compute.claims [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Claim successful on node user
Nov 14 12:55:40 user nova-compute[75258]: INFO nova.compute.resource_tracker [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating resource usage from migration ea4cf80c-dc99-4c24-b460-41040d9d3796
Nov 14 12:55:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-changed-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Refreshing instance network info cache due to event network-changed-1db3ef49-8294-4f19-95a7-6499221f589a. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] Acquiring lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] Acquired lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG nova.network.neutron [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Refreshing network info cache for port 1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.371s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:40 user nova-compute[75258]: INFO nova.compute.manager [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Migrating
Nov 14 12:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updated VIF entry in instance network info cache for port 1db3ef49-8294-4f19-95a7-6499221f589a. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-621504a1-8822-494d-9fbd-14161c9ef650 req-2a554af5-0692-4a5d-9d92-41162914aa04 service nova] Releasing lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquired lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG nova.network.neutron [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG nova.network.neutron [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Releasing lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Starting migrate_disk_and_power_off {{(pid=75258) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-e8ae1975-80d5-4c95-a8d3-0f38dc86f714 req-b84ada4b-9827-4b45-bdcd-09dbbb0d2f06 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8ae1975-80d5-4c95-a8d3-0f38dc86f714 req-b84ada4b-9827-4b45-bdcd-09dbbb0d2f06 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8ae1975-80d5-4c95-a8d3-0f38dc86f714 req-b84ada4b-9827-4b45-bdcd-09dbbb0d2f06 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8ae1975-80d5-4c95-a8d3-0f38dc86f714 req-b84ada4b-9827-4b45-bdcd-09dbbb0d2f06 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-e8ae1975-80d5-4c95-a8d3-0f38dc86f714 req-b84ada4b-9827-4b45-bdcd-09dbbb0d2f06 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:41 user nova-compute[75258]: WARNING nova.compute.manager [req-e8ae1975-80d5-4c95-a8d3-0f38dc86f714 req-b84ada4b-9827-4b45-bdcd-09dbbb0d2f06 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state resize_migrating.
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance destroyed successfully.
Nov 14 12:55:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-249838839',display_name='tempest-ServerActionsTestOtherA-server-249838839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-249838839',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-cgmyb0n6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:55:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=a7b11d71-ee0a-47e0-a1e2-2206f0be1b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1644040768-network", "vif_mac": "fa:16:3e:cd:67:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1644040768-network", "vif_mac": "fa:16:3e:cd:67:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_vif [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db3ef49-82, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56ef70b6-940a-4a63-a95a-64d3eefb852e) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: INFO os_vif [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82')
Nov 14 12:55:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:55:42 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f58923-beb5-4028-9c02-e69f19b1690f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:55:42 user nova-compute[75258]: No targets found.
Nov 14 12:55:42 user nova-compute[75258]: iSNS:
Nov 14 12:55:42 user nova-compute[75258]: No targets found.
Nov 14 12:55:42 user nova-compute[75258]: STATIC:
Nov 14 12:55:42 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43
Nov 14 12:55:42 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:42 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:42 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:55:42 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:42 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:42 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:55:42 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:42 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:42 user nova-compute[75258]: FIRMWARE:
Nov 14 12:55:42 user nova-compute[75258]: No targets found.
Nov 14 12:55:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:55:42 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:55:42 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[07e9666b-d446-4ab6-a7d0-888653f8282c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6c1ceb-8927-4146-ad06-5e27878ac732]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:42 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:42 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:42 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:42 user nova-compute[75258]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b43f9480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d'): ({'sdf'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Removing single pathed devices sdf {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6ba056-f24b-4276-a833-0d2368856c26]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[648b379d-4478-4f47-92ba-061c0e72cc46]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flushing IO for device /dev/sdf {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11bbca5c-f81a-4442-8ea3-93928f3645c0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.046s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ff0e823-cb2d-42e5-9001-80833ca38583]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] SCSI volumes sdf have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[14fb3689-e0cc-482e-ab14-d92e00998e32]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --logout" returned: 0 in 0.083s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[565af404-c46c-4b4e-9c4b-ee13468103bf]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]
Nov 14 12:55:42 user nova-compute[75258]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.
Nov 14 12:55:42 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[418583cc-5686-4610-8ffa-b891f672e070]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.366s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== disconnect_volume: return (369ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:55:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:43 user nova-compute[75258]: DEBUG nova.network.neutron [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Port 1db3ef49-8294-4f19-95a7-6499221f589a binding to destination host user is already ACTIVE {{(pid=75258) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3170}}
Nov 14 12:55:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:55:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquired lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:44 user nova-compute[75258]: WARNING nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state resize_migrated.
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:44 user nova-compute[75258]: WARNING nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state resize_migrated.
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:44 user nova-compute[75258]: WARNING nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state resize_migrated.
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:44 user nova-compute[75258]: WARNING nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state resize_migrated.
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:44 user nova-compute[75258]: WARNING nova.compute.manager [req-4f7054ae-f91a-4568-9fda-a726a8d56984 req-4e0ef24f-14d9-49b6-9728-047bd19e9174 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state resize_migrated.
Nov 14 12:55:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Releasing lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG os_brick.utils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[426cd36f-8846-4d19-8c16-62b7406c9464]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb0bd95f-51e9-4fb9-9080-e95a18a24c06]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3222e7-121c-443d-a323-3fb491686090]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8139ec2-ac0e-4126-85e0-8b05478afd82]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:55:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:55:45 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:55:45 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e94624-8bba-4708-960d-94f9a24a1065]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:55:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:55:45 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:55:45 user nova-compute[75258]: DEBUG os_brick.utils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:46 user nova-compute[75258]: INFO nova.compute.manager [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Terminating instance
Nov 14 12:55:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-76a03cd3-f558-41d5-aa5d-1d2133f8c334 req-1b36e3be-3945-4541-99be-65b49d37faa2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-vif-unplugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-76a03cd3-f558-41d5-aa5d-1d2133f8c334 req-1b36e3be-3945-4541-99be-65b49d37faa2 service nova] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-76a03cd3-f558-41d5-aa5d-1d2133f8c334 req-1b36e3be-3945-4541-99be-65b49d37faa2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-76a03cd3-f558-41d5-aa5d-1d2133f8c334 req-1b36e3be-3945-4541-99be-65b49d37faa2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-76a03cd3-f558-41d5-aa5d-1d2133f8c334 req-1b36e3be-3945-4541-99be-65b49d37faa2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] No waiting events found dispatching network-vif-unplugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:46 user nova-compute[75258]: DEBUG nova.compute.manager [req-76a03cd3-f558-41d5-aa5d-1d2133f8c334 req-1b36e3be-3945-4541-99be-65b49d37faa2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-vif-unplugged-c7130f86-d364-4030-99bd-cc6c1c668f28 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Instance destroyed successfully.
Nov 14 12:55:47 user nova-compute[75258]: DEBUG nova.objects.instance [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lazy-loading 'resources' on Instance uuid 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:36:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1441769746',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1441769746',id=2,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:36:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c593ba588c7f442689362cda037f95f8',ramdisk_id='',reservation_id='r-khlk59k3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:38:06Z,user_data=None,user_id='cef85161135e4a978dd763ae91809be9',uuid=9de856ad-8adc-46f6-9e9d-ec7ed6eea63c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converting VIF {"id": "c7130f86-d364-4030-99bd-cc6c1c668f28", "address": "fa:16:3e:24:d1:95", "network": {"id": "b04005b3-d197-4872-a5bc-af93c876bdf0", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-486634621-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c593ba588c7f442689362cda037f95f8", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc7130f86-d3", "ovs_interfaceid": "c7130f86-d364-4030-99bd-cc6c1c668f28", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:24:d1:95,bridge_name='br-int',has_traffic_filtering=True,id=c7130f86-d364-4030-99bd-cc6c1c668f28,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7130f86-d3') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG os_vif [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:d1:95,bridge_name='br-int',has_traffic_filtering=True,id=c7130f86-d364-4030-99bd-cc6c1c668f28,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7130f86-d3') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc7130f86-d3, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=27335b2a-8517-486d-ae22-a62c13b48a6b) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:47 user nova-compute[75258]: INFO os_vif [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:24:d1:95,bridge_name='br-int',has_traffic_filtering=True,id=c7130f86-d364-4030-99bd-cc6c1c668f28,network=Network(b04005b3-d197-4872-a5bc-af93c876bdf0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc7130f86-d3')
Nov 14 12:55:47 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Deleting instance files /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c_del
Nov 14 12:55:47 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Deletion of /opt/stack/data/nova/instances/9de856ad-8adc-46f6-9e9d-ec7ed6eea63c_del complete
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: INFO nova.compute.manager [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 12:55:47 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:48 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Took 0.71 seconds to deallocate network for instance.
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-a1c076b4-23e2-469a-8a92-7ccd07de2494 req-bcfc8bb1-e02a-4568-99ed-e83a7c870623 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-vif-deleted-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:48 user nova-compute[75258]: INFO nova.compute.manager [req-a1c076b4-23e2-469a-8a92-7ccd07de2494 req-bcfc8bb1-e02a-4568-99ed-e83a7c870623 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Neutron deleted interface c7130f86-d364-4030-99bd-cc6c1c668f28; detaching it from the instance and deleting it from the info cache
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.network.neutron [req-a1c076b4-23e2-469a-8a92-7ccd07de2494 req-bcfc8bb1-e02a-4568-99ed-e83a7c870623 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-a1c076b4-23e2-469a-8a92-7ccd07de2494 req-bcfc8bb1-e02a-4568-99ed-e83a7c870623 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Detach interface failed, port_id=c7130f86-d364-4030-99bd-cc6c1c668f28, reason: Instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.281s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:48 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Deleted allocations for instance 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-eaba3c39-7ac1-4edf-a0be-c8316f1dec21 tempest-ServerBootFromVolumeStableRescueTest-1735756414 tempest-ServerBootFromVolumeStableRescueTest-1735756414-project-member] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] No waiting events found dispatching network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:48 user nova-compute[75258]: WARNING nova.compute.manager [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received unexpected event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 for instance with vm_state deleted and task_state None.
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] Acquiring lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] Lock "9de856ad-8adc-46f6-9e9d-ec7ed6eea63c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] No waiting events found dispatching network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:48 user nova-compute[75258]: WARNING nova.compute.manager [req-537a7a26-b5b3-4d29-b990-e132ffae9344 req-c788e614-48c0-497b-a145-1f64b58759d2 service nova] [instance: 9de856ad-8adc-46f6-9e9d-ec7ed6eea63c] Received unexpected event network-vif-plugged-c7130f86-d364-4030-99bd-cc6c1c668f28 for instance with vm_state deleted and task_state None.
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Starting finish_migration {{(pid=75258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 12:55:49 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Creating image(s)
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Ensure instance console log exists: /opt/stack/data/nova/instances/a7b11d71-ee0a-47e0-a1e2-2206f0be1b46/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Start _get_guest_xml network_info=[{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1644040768-network", "vif_mac": "fa:16:3e:cd:67:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'a7b11d71-ee0a-47e0-a1e2-2206f0be1b46', 'attached_at': '2023-11-14T12:55:49.000000', 'detached_at': '', 'volume_id': '10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'serial': '10da2cc0-95ea-4f88-83ef-2db5d629e03d'}, 'device_type': 'disk', 'attachment_id': 'bdd5b26b-5418-449e-9460-738e8076b1b9', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:55:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:55:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:20Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:55:49 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:55:49 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:55:49 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8191902-ea4f-4c58-92b9-8485893386e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:55:49 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9978203-6ee8-4bac-9630-512e43d4343c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d] added
Nov 14 12:55:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e55a03-dcd7-43f2-b8ca-1ef9dd7fa7ce]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de28d130-8485-4c94-9906-4671d247a458]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDgjuYO {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v GzDgjuYO" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e65fc99-e53a-403f-965d-64637468de2d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'GzDgjuYO'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b707d0c1-3065-4767-b994-481c273fa3d0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ec0d65-d49a-446d-baed-7dbca1d56db8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[568ac8fb-8498-4274-8ba2-4efbede94eef]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]
Nov 14 12:55:49 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.
Nov 14 12:55:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6562372e-630d-46c3-b83a-9cdd15801fc6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a30b253-3539-41e2-a085-9fc4b8481b18]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:49 user nova-compute[75258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] HCTL ('34', '-', '-', 0) found on session 48 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51b437f4-7382-4421-bcb0-b6d60a86c62e]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:55:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Searching for a device in session 48 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '26464636331353636', 'path': '/dev/sdc'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26464636331353636', 'path': '/dev/sdc'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-249838839',display_name='tempest-ServerActionsTestOtherA-server-249838839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-249838839',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-cgmyb0n6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=a7b11d71-ee0a-47e0-a1e2-2206f0be1b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1644040768-network", "vif_mac": "fa:16:3e:cd:67:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1644040768-network", "vif_mac": "fa:16:3e:cd:67:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:55:50 user nova-compute[75258]:   <uuid>a7b11d71-ee0a-47e0-a1e2-2206f0be1b46</uuid>
Nov 14 12:55:50 user nova-compute[75258]:   <name>instance-00000021</name>
Nov 14 12:55:50 user nova-compute[75258]:   <memory>2097152</memory>
Nov 14 12:55:50 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:55:50 user nova-compute[75258]:   <metadata>
Nov 14 12:55:50 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:55:50 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:55:50 user nova-compute[75258]:       <nova:name>tempest-ServerActionsTestOtherA-server-249838839</nova:name>
Nov 14 12:55:50 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:55:49</nova:creationTime>
Nov 14 12:55:50 user nova-compute[75258]:       <nova:flavor name="m1.small">
Nov 14 12:55:50 user nova-compute[75258]:         <nova:memory>2048</nova:memory>
Nov 14 12:55:50 user nova-compute[75258]:         <nova:disk>20</nova:disk>
Nov 14 12:55:50 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:55:50 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:55:50 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:55:50 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:55:50 user nova-compute[75258]:       <nova:owner>
Nov 14 12:55:50 user nova-compute[75258]:         <nova:user uuid="974df2b5a20f414eadb9e84383523e4f">tempest-ServerActionsTestOtherA-1553354563-project-member</nova:user>
Nov 14 12:55:50 user nova-compute[75258]:         <nova:project uuid="a6dc8f5ff4bf4a4788a2f7ec14b844f5">tempest-ServerActionsTestOtherA-1553354563</nova:project>
Nov 14 12:55:50 user nova-compute[75258]:       </nova:owner>
Nov 14 12:55:50 user nova-compute[75258]:       <nova:ports>
Nov 14 12:55:50 user nova-compute[75258]:         <nova:port uuid="1db3ef49-8294-4f19-95a7-6499221f589a">
Nov 14 12:55:50 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 12:55:50 user nova-compute[75258]:         </nova:port>
Nov 14 12:55:50 user nova-compute[75258]:       </nova:ports>
Nov 14 12:55:50 user nova-compute[75258]:     </nova:instance>
Nov 14 12:55:50 user nova-compute[75258]:   </metadata>
Nov 14 12:55:50 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:55:50 user nova-compute[75258]:     <system>
Nov 14 12:55:50 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:55:50 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:55:50 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:55:50 user nova-compute[75258]:       <entry name="serial">a7b11d71-ee0a-47e0-a1e2-2206f0be1b46</entry>
Nov 14 12:55:50 user nova-compute[75258]:       <entry name="uuid">a7b11d71-ee0a-47e0-a1e2-2206f0be1b46</entry>
Nov 14 12:55:50 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:55:50 user nova-compute[75258]:     </system>
Nov 14 12:55:50 user nova-compute[75258]:   </sysinfo>
Nov 14 12:55:50 user nova-compute[75258]:   <os>
Nov 14 12:55:50 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:55:50 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:55:50 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:55:50 user nova-compute[75258]:   </os>
Nov 14 12:55:50 user nova-compute[75258]:   <features>
Nov 14 12:55:50 user nova-compute[75258]:     <acpi/>
Nov 14 12:55:50 user nova-compute[75258]:     <apic/>
Nov 14 12:55:50 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:55:50 user nova-compute[75258]:   </features>
Nov 14 12:55:50 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:55:50 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:55:50 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:55:50 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:55:50 user nova-compute[75258]:   </clock>
Nov 14 12:55:50 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:55:50 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:55:50 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:55:50 user nova-compute[75258]:   </cpu>
Nov 14 12:55:50 user nova-compute[75258]:   <devices>
Nov 14 12:55:50 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 12:55:50 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:55:50 user nova-compute[75258]:       <source dev="/dev/sdc"/>
Nov 14 12:55:50 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:55:50 user nova-compute[75258]:       <serial>10da2cc0-95ea-4f88-83ef-2db5d629e03d</serial>
Nov 14 12:55:50 user nova-compute[75258]:     </disk>
Nov 14 12:55:50 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:55:50 user nova-compute[75258]:       <mac address="fa:16:3e:cd:67:df"/>
Nov 14 12:55:50 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:55:50 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:55:50 user nova-compute[75258]:       <target dev="tap1db3ef49-82"/>
Nov 14 12:55:50 user nova-compute[75258]:     </interface>
Nov 14 12:55:50 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:55:50 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/a7b11d71-ee0a-47e0-a1e2-2206f0be1b46/console.log" append="off"/>
Nov 14 12:55:50 user nova-compute[75258]:     </serial>
Nov 14 12:55:50 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:55:50 user nova-compute[75258]:     <video>
Nov 14 12:55:50 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:55:50 user nova-compute[75258]:     </video>
Nov 14 12:55:50 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:55:50 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:55:50 user nova-compute[75258]:     </rng>
Nov 14 12:55:50 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:55:50 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:55:50 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:55:50 user nova-compute[75258]:     </memballoon>
Nov 14 12:55:50 user nova-compute[75258]:   </devices>
Nov 14 12:55:50 user nova-compute[75258]: </domain>
Nov 14 12:55:50 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-249838839',display_name='tempest-ServerActionsTestOtherA-server-249838839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-249838839',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:53:58Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-cgmyb0n6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:55:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=a7b11d71-ee0a-47e0-a1e2-2206f0be1b46,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1644040768-network", "vif_mac": "fa:16:3e:cd:67:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1644040768-network", "vif_mac": "fa:16:3e:cd:67:df"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG os_vif [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'cf3d6eb9-0a5f-599e-8986-40fca881a0d4', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap1db3ef49-82, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap1db3ef49-82, col_values=(('qos', UUID('f372e708-26ee-45ca-bae0-06e8accccaae')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap1db3ef49-82, col_values=(('external_ids', {'iface-id': '1db3ef49-8294-4f19-95a7-6499221f589a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cd:67:df', 'vm-uuid': 'a7b11d71-ee0a-47e0-a1e2-2206f0be1b46'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:50 user nova-compute[75258]: INFO os_vif [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82')
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:55:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] No VIF found with MAC fa:16:3e:cd:67:df, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:55:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c is timed out.
Nov 14 12:55:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully detached device vdb from instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c from the live domain config.
Nov 14 12:55:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'snGHfwSp', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:55:51 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5db8a1a0-ddc1-4cca-b2e5-85ecb6c36751]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:55:51 user nova-compute[75258]: No targets found.
Nov 14 12:55:51 user nova-compute[75258]: iSNS:
Nov 14 12:55:51 user nova-compute[75258]: No targets found.
Nov 14 12:55:51 user nova-compute[75258]: STATIC:
Nov 14 12:55:51 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43
Nov 14 12:55:51 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:51 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:51 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:55:51 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:51 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:51 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:55:51 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:55:51 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:55:51 user nova-compute[75258]: FIRMWARE:
Nov 14 12:55:51 user nova-compute[75258]: No targets found.
Nov 14 12:55:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:55:51 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:55:51 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27157374-f9d1-4c81-9819-f1418ec20662]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[028ca9ec-64fe-4fd8-88c6-ca9732b1b1d4]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:51 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:51 user nova-compute[75258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 (non-flash)
Nov 14 12:55:51 user nova-compute[75258]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:55:51 user nova-compute[75258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:55:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c5ab250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90033dd-61f1-4b12-837e-0cfcd2185fe8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b220d1f-000b-423d-a9dc-dc073f827b59]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f128cf-22a1-489a-bb74-56fc342aa493]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[16dcc21d-f703-4e21-a37c-6dd2d8e93128]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c68e89-feb3-4499-adaf-a5a8d52a0f81]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38809d4b-af2e-4f7a-8097-ab78174885d2]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260]
Nov 14 12:55:51 user nova-compute[75258]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43, portal: 172.16.0.220,3260] successful.
Nov 14 12:55:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d8803b6b-6006-4444-8a1b-ee5ff8a98e43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c460c19-14a9-4c9f-b962-92dc2ad8f0a7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== disconnect_volume: return (299ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:55:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-375913dc-6936-4937-81af-b82af2dd9580 req-404dd442-29f8-491b-bb7d-fa64bd93b0dd service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-375913dc-6936-4937-81af-b82af2dd9580 req-404dd442-29f8-491b-bb7d-fa64bd93b0dd service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-375913dc-6936-4937-81af-b82af2dd9580 req-404dd442-29f8-491b-bb7d-fa64bd93b0dd service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-375913dc-6936-4937-81af-b82af2dd9580 req-404dd442-29f8-491b-bb7d-fa64bd93b0dd service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-375913dc-6936-4937-81af-b82af2dd9580 req-404dd442-29f8-491b-bb7d-fa64bd93b0dd service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:52 user nova-compute[75258]: WARNING nova.compute.manager [req-375913dc-6936-4937-81af-b82af2dd9580 req-404dd442-29f8-491b-bb7d-fa64bd93b0dd service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state resize_finish.
Nov 14 12:55:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:55:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5fc7240c-a009-4e40-bc8a-c3e704a68621 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.792s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:55:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance running successfully.
Nov 14 12:55:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Failed to set time: agent not configured {{(pid=75258) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Nov 14 12:55:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-123623e5-ebd0-4764-bb02-b08bfe66e888 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] finish_migration finished successfully. {{(pid=75258) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Nov 14 12:55:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-46b38ae4-a279-4b47-a694-85d972d0ca3b req-050da22b-0193-4496-a39d-ab3567eb6d87 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:55:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-46b38ae4-a279-4b47-a694-85d972d0ca3b req-050da22b-0193-4496-a39d-ab3567eb6d87 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-46b38ae4-a279-4b47-a694-85d972d0ca3b req-050da22b-0193-4496-a39d-ab3567eb6d87 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-46b38ae4-a279-4b47-a694-85d972d0ca3b req-050da22b-0193-4496-a39d-ab3567eb6d87 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:55:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-46b38ae4-a279-4b47-a694-85d972d0ca3b req-050da22b-0193-4496-a39d-ab3567eb6d87 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:55:54 user nova-compute[75258]: WARNING nova.compute.manager [req-46b38ae4-a279-4b47-a694-85d972d0ca3b req-050da22b-0193-4496-a39d-ab3567eb6d87 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state resized and task_state None.
Nov 14 12:55:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:55:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:55:59 user nova-compute[75258]: INFO nova.compute.manager [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Detaching volume 048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:55:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:55:59 user nova-compute[75258]: INFO nova.virt.block_device [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Attempting to driver detach volume 048e2e04-0357-4ab7-a6c6-c696a383f4a5 from mountpoint /dev/vdb
Nov 14 12:55:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Attempting to detach device vdb from instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:55:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:55:59 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:55:59 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:55:59 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:55:59 user nova-compute[75258]:   <serial>048e2e04-0357-4ab7-a6c6-c696a383f4a5</serial>
Nov 14 12:55:59 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:55:59 user nova-compute[75258]: </disk>
Nov 14 12:55:59 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:55:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Successfully detached device vdb from instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 from the persistent domain config.
Nov 14 12:55:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:55:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:55:59 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:55:59 user nova-compute[75258]:   <source dev="/dev/sde"/>
Nov 14 12:55:59 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:55:59 user nova-compute[75258]:   <serial>048e2e04-0357-4ab7-a6c6-c696a383f4a5</serial>
Nov 14 12:55:59 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:55:59 user nova-compute[75258]: </disk>
Nov 14 12:55:59 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:56:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:56:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:10 user nova-compute[75258]: INFO nova.compute.manager [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Terminating instance
Nov 14 12:56:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-0c00dc05-762d-472d-b129-47c35b6ef54a req-ceb41bb3-1085-438e-bcc8-691eed028e76 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-unplugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0c00dc05-762d-472d-b129-47c35b6ef54a req-ceb41bb3-1085-438e-bcc8-691eed028e76 service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0c00dc05-762d-472d-b129-47c35b6ef54a req-ceb41bb3-1085-438e-bcc8-691eed028e76 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0c00dc05-762d-472d-b129-47c35b6ef54a req-ceb41bb3-1085-438e-bcc8-691eed028e76 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-0c00dc05-762d-472d-b129-47c35b6ef54a req-ceb41bb3-1085-438e-bcc8-691eed028e76 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-unplugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-0c00dc05-762d-472d-b129-47c35b6ef54a req-ceb41bb3-1085-438e-bcc8-691eed028e76 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-unplugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Instance destroyed successfully.
Nov 14 12:56:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lazy-loading 'resources' on Instance uuid 2c78427a-e54f-4763-be94-b8e20263c6d9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:51:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1431813287',display_name='tempest-TestMinimumBasicScenario-server-1431813287',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1431813287',id=30,image_ref='193fe459-9010-49db-a183-f0f688c19ae3',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBpKQ68vihkwCPBlplouaoI/5NHyYi5zb2kksm7RqqzVGvyl7DOqbM498MFtmCZPZESDOgI1w61+5Fp6qf/G3ZQsu+NaaF4XmCY3VBl5SShOcl7EqCPQJsyYcYTRwGeAxw==',key_name='tempest-TestMinimumBasicScenario-910490175',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:51:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c4804d74a9a74c02b945b46f8c4e7183',ramdisk_id='',reservation_id='r-axep7ewp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='193fe459-9010-49db-a183-f0f688c19ae3',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-30457951',owner_user_name='tempest-TestMinimumBasicScenario-30457951-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:53:33Z,user_data=None,user_id='46ecec8040474acc8f5104e2e906d4e8',uuid=2c78427a-e54f-4763-be94-b8e20263c6d9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converting VIF {"id": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "address": "fa:16:3e:2e:3f:a4", "network": {"id": "728ef2f5-a634-45c0-9107-08b08755ea9a", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1811461275-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c4804d74a9a74c02b945b46f8c4e7183", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6d604cf0-61", "ovs_interfaceid": "6d604cf0-6140-43b3-a2b0-8d4ab2b77cda", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:2e:3f:a4,bridge_name='br-int',has_traffic_filtering=True,id=6d604cf0-6140-43b3-a2b0-8d4ab2b77cda,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d604cf0-61') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG os_vif [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:3f:a4,bridge_name='br-int',has_traffic_filtering=True,id=6d604cf0-6140-43b3-a2b0-8d4ab2b77cda,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d604cf0-61') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6d604cf0-61, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=51f24b04-9225-425b-8351-f554742c8cbd) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:11 user nova-compute[75258]: INFO os_vif [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:2e:3f:a4,bridge_name='br-int',has_traffic_filtering=True,id=6d604cf0-6140-43b3-a2b0-8d4ab2b77cda,network=Network(728ef2f5-a634-45c0-9107-08b08755ea9a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6d604cf0-61')
Nov 14 12:56:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Deleting instance files /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9_del
Nov 14 12:56:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Deletion of /opt/stack/data/nova/instances/2c78427a-e54f-4763-be94-b8e20263c6d9_del complete
Nov 14 12:56:11 user nova-compute[75258]: INFO nova.compute.manager [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Took 0.83 seconds to destroy the instance on the hypervisor.
Nov 14 12:56:11 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:56:11 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Took 0.46 seconds to deallocate network for instance.
Nov 14 12:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.238s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:12 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Deleted allocations for instance 2c78427a-e54f-4763-be94-b8e20263c6d9
Nov 14 12:56:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c718da17-8bea-4ef2-88bd-abf14b12b722 tempest-TestMinimumBasicScenario-30457951 tempest-TestMinimumBasicScenario-30457951-project-member] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.702s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-56a7f26d-d246-4b05-a4c9-3f42538bfa48 req-bc9b5880-428e-4595-80c3-1fe3cc2ab7d1 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-56a7f26d-d246-4b05-a4c9-3f42538bfa48 req-bc9b5880-428e-4595-80c3-1fe3cc2ab7d1 service nova] Acquiring lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-56a7f26d-d246-4b05-a4c9-3f42538bfa48 req-bc9b5880-428e-4595-80c3-1fe3cc2ab7d1 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-56a7f26d-d246-4b05-a4c9-3f42538bfa48 req-bc9b5880-428e-4595-80c3-1fe3cc2ab7d1 service nova] Lock "2c78427a-e54f-4763-be94-b8e20263c6d9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-56a7f26d-d246-4b05-a4c9-3f42538bfa48 req-bc9b5880-428e-4595-80c3-1fe3cc2ab7d1 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] No waiting events found dispatching network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:12 user nova-compute[75258]: WARNING nova.compute.manager [req-56a7f26d-d246-4b05-a4c9-3f42538bfa48 req-bc9b5880-428e-4595-80c3-1fe3cc2ab7d1 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received unexpected event network-vif-plugged-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda for instance with vm_state deleted and task_state None.
Nov 14 12:56:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-56a7f26d-d246-4b05-a4c9-3f42538bfa48 req-bc9b5880-428e-4595-80c3-1fe3cc2ab7d1 service nova] [instance: 2c78427a-e54f-4763-be94-b8e20263c6d9] Received event network-vif-deleted-6d604cf0-6140-43b3-a2b0-8d4ab2b77cda {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:56:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:56:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:56:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:56:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [{"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-94a7efee-d97e-4638-a2d7-2c526a0bc148" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 is timed out.
Nov 14 12:56:20 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Successfully detached device vdb from instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 from the live domain config.
Nov 14 12:56:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'DYfwBJGa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:56:20 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[325d3631-37eb-442e-9bfe-73b4b17b13af]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:56:20 user nova-compute[75258]: No targets found.
Nov 14 12:56:20 user nova-compute[75258]: iSNS:
Nov 14 12:56:20 user nova-compute[75258]: No targets found.
Nov 14 12:56:20 user nova-compute[75258]: STATIC:
Nov 14 12:56:20 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:56:20 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:56:20 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:56:20 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5
Nov 14 12:56:20 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:56:20 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:56:20 user nova-compute[75258]: FIRMWARE:
Nov 14 12:56:20 user nova-compute[75258]: No targets found.
Nov 14 12:56:20 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:56:20 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:56:20 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fb50b7-4184-4814-8c84-81391b945f5b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ef3dc69-02d4-4734-bfee-035d3017073c]: (4, ('tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:56:20 user nova-compute[75258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:56:20 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsi session list stdout=tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 (non-flash)
Nov 14 12:56:20 user nova-compute[75258]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:56:20 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7679a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5'): ({'sde'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Removing single pathed devices sde {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4675e8e-3c6b-47fb-9e05-4b7d27ca6931]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9694fa4-75b5-4c8e-aebd-4390279bca21]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Flushing IO for device /dev/sde {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc0e2756-35c2-4c1e-b743-32edc6f1b749]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f2f4a-432f-4d8e-ac42-4af4f3abc608]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] SCSI volumes sde have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c334290d-c301-41cf-90b5-0eeb94bd105e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e594bded-6eab-4fa3-abaf-250d416decfc]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260]
Nov 14 12:56:20 user nova-compute[75258]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5, portal: 172.16.0.220,3260] successful.
Nov 14 12:56:20 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:048e2e04-0357-4ab7-a6c6-c696a383f4a5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71cd7e1-fb2d-47f8-8c25-432c077dd45e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.284s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] <== disconnect_volume: return (285ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:56:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:21 user nova-compute[75258]: INFO nova.compute.manager [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Terminating instance
Nov 14 12:56:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG nova.objects.instance [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'flavor' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-df9c712f-4e92-46e6-9a7d-f7e850717f05 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.854s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-6acca74e-6c5f-4e85-bc45-da20e03af8c4 req-95d6ebf2-1a01-4dc2-858e-0f98140d002e service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-unplugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6acca74e-6c5f-4e85-bc45-da20e03af8c4 req-95d6ebf2-1a01-4dc2-858e-0f98140d002e service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6acca74e-6c5f-4e85-bc45-da20e03af8c4 req-95d6ebf2-1a01-4dc2-858e-0f98140d002e service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6acca74e-6c5f-4e85-bc45-da20e03af8c4 req-95d6ebf2-1a01-4dc2-858e-0f98140d002e service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-6acca74e-6c5f-4e85-bc45-da20e03af8c4 req-95d6ebf2-1a01-4dc2-858e-0f98140d002e service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-unplugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-6acca74e-6c5f-4e85-bc45-da20e03af8c4 req-95d6ebf2-1a01-4dc2-858e-0f98140d002e service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-unplugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Instance destroyed successfully.
Nov 14 12:56:22 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'resources' on Instance uuid 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:50:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-874433275',display_name='tempest-AttachVolumeNegativeTest-server-874433275',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-874433275',id=29,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNEZ+of53iIs70+PTJPFCFbWPQTeGEXjBuGgJzpnYp6J7BCrPHbjib9qVcq9mT11Cs1OigHsiPbkvtHH4RVcxZDOhSMA/zdXfvdXfSX0TBEK+qlTKwLIyscdoNv8PDF2IQ==',key_name='tempest-keypair-1476065429',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:50:52Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-g0j1zbj6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:50:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=58a3630a-6d1e-4538-b1d1-6c501fd5bc2c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "address": "fa:16:3e:7e:8a:be", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.177", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc4485ddb-95", "ovs_interfaceid": "c4485ddb-95e4-4f03-9884-3f9f066fed05", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8a:be,bridge_name='br-int',has_traffic_filtering=True,id=c4485ddb-95e4-4f03-9884-3f9f066fed05,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4485ddb-95') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG os_vif [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8a:be,bridge_name='br-int',has_traffic_filtering=True,id=c4485ddb-95e4-4f03-9884-3f9f066fed05,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4485ddb-95') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc4485ddb-95, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=90cfe1ef-a646-4aba-b5ca-9e44b6aed9ab) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:22 user nova-compute[75258]: INFO os_vif [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7e:8a:be,bridge_name='br-int',has_traffic_filtering=True,id=c4485ddb-95e4-4f03-9884-3f9f066fed05,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc4485ddb-95')
Nov 14 12:56:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Deleting instance files /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c_del
Nov 14 12:56:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Deletion of /opt/stack/data/nova/instances/58a3630a-6d1e-4538-b1d1-6c501fd5bc2c_del complete
Nov 14 12:56:22 user nova-compute[75258]: INFO nova.compute.manager [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 12:56:22 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:56:23 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Took 1.00 seconds to deallocate network for instance.
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.304s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:23 user nova-compute[75258]: WARNING nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received unexpected event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with vm_state deleted and task_state None.
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:23 user nova-compute[75258]: WARNING nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received unexpected event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with vm_state deleted and task_state None.
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:23 user nova-compute[75258]: WARNING nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received unexpected event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with vm_state deleted and task_state None.
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-unplugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-unplugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:23 user nova-compute[75258]: WARNING nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received unexpected event network-vif-unplugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with vm_state deleted and task_state None.
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Acquiring lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] No waiting events found dispatching network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:23 user nova-compute[75258]: WARNING nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received unexpected event network-vif-plugged-c4485ddb-95e4-4f03-9884-3f9f066fed05 for instance with vm_state deleted and task_state None.
Nov 14 12:56:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-58d4355f-33e5-4d86-864d-3bd4ea21dbeb req-674b8cbe-6907-4782-8992-23a21e7194b6 service nova] [instance: 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c] Received event network-vif-deleted-c4485ddb-95e4-4f03-9884-3f9f066fed05 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:23 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Deleted allocations for instance 58a3630a-6d1e-4538-b1d1-6c501fd5bc2c
Nov 14 12:56:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ff9ff3cb-b0fa-4cb5-8da3-cc2519e30dbb tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "58a3630a-6d1e-4538-b1d1-6c501fd5bc2c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.443s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:56:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:56:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8224MB free_disk=24.928382873535156GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Applying migration context for instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 as it has an incoming, in-progress migration ea4cf80c-dc99-4c24-b460-41040d9d3796. Migration status is finished {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 12:56:27 user nova-compute[75258]: INFO nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating resource usage from migration ea4cf80c-dc99-4c24-b460-41040d9d3796
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 94a7efee-d97e-4638-a2d7-2c526a0bc148 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 655df082-9b52-4bf6-8de5-e98f500e7454 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 01f7b533-1825-4ea5-a580-7f6442e3630e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Migration ea4cf80c-dc99-4c24-b460-41040d9d3796 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:56:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.349s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:56:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:56:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:56:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:56:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 12:56:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:56:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 12:56:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:50 user nova-compute[75258]: INFO nova.compute.manager [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Terminating instance
Nov 14 12:56:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6cc2c313-56ef-4cb8-80fd-1d957979fa58 req-1a730e63-2c5e-43fd-9741-22eb8acb08bf service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6cc2c313-56ef-4cb8-80fd-1d957979fa58 req-1a730e63-2c5e-43fd-9741-22eb8acb08bf service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6cc2c313-56ef-4cb8-80fd-1d957979fa58 req-1a730e63-2c5e-43fd-9741-22eb8acb08bf service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6cc2c313-56ef-4cb8-80fd-1d957979fa58 req-1a730e63-2c5e-43fd-9741-22eb8acb08bf service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6cc2c313-56ef-4cb8-80fd-1d957979fa58 req-1a730e63-2c5e-43fd-9741-22eb8acb08bf service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-6cc2c313-56ef-4cb8-80fd-1d957979fa58 req-1a730e63-2c5e-43fd-9741-22eb8acb08bf service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-unplugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:56:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Instance destroyed successfully.
Nov 14 12:56:51 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lazy-loading 'resources' on Instance uuid 94a7efee-d97e-4638-a2d7-2c526a0bc148 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:49:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-310526585',display_name='tempest-ServerStableDeviceRescueTest-server-310526585',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-310526585',id=28,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMG2e4IB1za5Z+ErNPEkFDOSfaS97gX1KNSyYOquhPEa3PIidS2htvR8u3/MpC6Vg9o03CK36r386GijlvYb+EV9lJrjPsoT4y415VdDfbaJlxwPmUQILxfjzOis/P4JIA==',key_name='tempest-keypair-1454761844',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:53:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='04ad4523c046417ba2124dce941487fa',ramdisk_id='',reservation_id='r-i2f82awa',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-935137255',owner_user_name='tempest-ServerStableDeviceRescueTest-935137255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:55:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ff4a59da80f249b891b10a581146f0dd',uuid=94a7efee-d97e-4638-a2d7-2c526a0bc148,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converting VIF {"id": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "address": "fa:16:3e:63:41:94", "network": {"id": "a95d2ab8-cf45-4c52-922e-207c9b935dc1", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-288510549-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.34", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "04ad4523c046417ba2124dce941487fa", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0f4ff176-a9", "ovs_interfaceid": "0f4ff176-a93c-4da3-97d1-a4bbf3de403a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG os_vif [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0f4ff176-a9, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c358817f-6952-450f-a606-df79a474ae4c) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:51 user nova-compute[75258]: INFO os_vif [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:63:41:94,bridge_name='br-int',has_traffic_filtering=True,id=0f4ff176-a93c-4da3-97d1-a4bbf3de403a,network=Network(a95d2ab8-cf45-4c52-922e-207c9b935dc1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0f4ff176-a9')
Nov 14 12:56:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Deleting instance files /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148_del
Nov 14 12:56:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Deletion of /opt/stack/data/nova/instances/94a7efee-d97e-4638-a2d7-2c526a0bc148_del complete
Nov 14 12:56:51 user nova-compute[75258]: INFO nova.compute.manager [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 12:56:51 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:56:51 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Took 0.76 seconds to deallocate network for instance.
Nov 14 12:56:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.242s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:52 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Deleted allocations for instance 94a7efee-d97e-4638-a2d7-2c526a0bc148
Nov 14 12:56:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5074a5e3-71b0-4b5c-a94e-c37ce912bff6 tempest-ServerStableDeviceRescueTest-935137255 tempest-ServerStableDeviceRescueTest-935137255-project-member] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.077s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-a7aa893e-b9b1-46f9-a850-6e0350b04516 req-2ddd92a0-64de-4a97-b30c-86bfe1eb491b service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a7aa893e-b9b1-46f9-a850-6e0350b04516 req-2ddd92a0-64de-4a97-b30c-86bfe1eb491b service nova] Acquiring lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a7aa893e-b9b1-46f9-a850-6e0350b04516 req-2ddd92a0-64de-4a97-b30c-86bfe1eb491b service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a7aa893e-b9b1-46f9-a850-6e0350b04516 req-2ddd92a0-64de-4a97-b30c-86bfe1eb491b service nova] Lock "94a7efee-d97e-4638-a2d7-2c526a0bc148-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-a7aa893e-b9b1-46f9-a850-6e0350b04516 req-2ddd92a0-64de-4a97-b30c-86bfe1eb491b service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] No waiting events found dispatching network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:56:52 user nova-compute[75258]: WARNING nova.compute.manager [req-a7aa893e-b9b1-46f9-a850-6e0350b04516 req-2ddd92a0-64de-4a97-b30c-86bfe1eb491b service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received unexpected event network-vif-plugged-0f4ff176-a93c-4da3-97d1-a4bbf3de403a for instance with vm_state deleted and task_state None.
Nov 14 12:56:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-a7aa893e-b9b1-46f9-a850-6e0350b04516 req-2ddd92a0-64de-4a97-b30c-86bfe1eb491b service nova] [instance: 94a7efee-d97e-4638-a2d7-2c526a0bc148] Received event network-vif-deleted-0f4ff176-a93c-4da3-97d1-a4bbf3de403a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-changed-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Refreshing instance network info cache due to event network-changed-7cd0b4a2-0562-45c8-a9bf-23a3210f1506. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] Acquiring lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] Acquired lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG nova.network.neutron [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Refreshing network info cache for port 7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG nova.objects.instance [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'flavor' on Instance uuid 01f7b533-1825-4ea5-a580-7f6442e3630e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:56:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:56:54 user nova-compute[75258]: INFO nova.compute.manager [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Attaching volume 2b720084-2557-46c6-9ebb-a5b7f44b1636 to /dev/vdb
Nov 14 12:56:54 user nova-compute[75258]: DEBUG os_brick.utils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[81fcd7b7-3056-4cb3-ba2c-4f3fff3ea2c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf18947c-c82e-4d16-8e61-00eeb23451b5]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG nova.network.neutron [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updated VIF entry in instance network info cache for port 7cd0b4a2-0562-45c8-a9bf-23a3210f1506. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG nova.network.neutron [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updating instance_info_cache with network_info: [{"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e0c4ff8-735b-4f9d-9625-b763484383d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b2a496-d916-4491-8c31-2cc32614eb57]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5554221c-08f5-4124-a12e-7f72c8300af0 req-9fbe6f0d-b80e-4e7e-a987-d8d7d26b6286 service nova] Releasing lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:56:54 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:56:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6ebcef7-8aed-4141-a43a-a66279ac5b9b]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG os_brick.utils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updating existing volume attachment record: ede2d5a6-d34e-431f-bb54-39f6b1c0aa3b {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:56:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXszwZHJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:56:58 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:56:58 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:56:58 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7472987f-dbe6-4132-b848-3a2c34610dec]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:56:58 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca0783fe-c237-4ae6-aedd-b1ebd43db558]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636] added
Nov 14 12:56:58 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d3266f-9edf-4aa3-8132-0774e2955328]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[61eca38e-09b1-450c-a80b-a33b2182ea54]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXszwZHJ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MXszwZHJ" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4418d142-a194-41a3-82f7-afdc0364d847]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MXszwZHJ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df223e4-c629-4449-8b8c-544afb981564]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c4ac19-7811-4414-932d-79a0c931dd88]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:56:58 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:56:58 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --login" returned: 0 in 0.062s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4085931-83bf-4c2b-8033-53c8f9362078]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260]
Nov 14 12:56:58 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260] successful.
Nov 14 12:56:58 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd5e6779-b108-4016-a0a4-45d9d1eade8f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eab83caf-d847-412a-ab4c-ab99f13fb6f0]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:56:58 user nova-compute[75258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 (non-flash)
Nov 14 12:56:58 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:56:58 user nova-compute[75258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 (non-flash)
Nov 14 12:56:58 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.280s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e4c7b76-5010-43f4-a34c-34184ff72869]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:56:58 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXszwZHJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:56:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:56:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.314s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:56:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] <== connect_volume: return (1315ms) {'type': 'block', 'scsi_wwn': '26631616535393631', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:56:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26631616535393631', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:56:59 user nova-compute[75258]: DEBUG nova.objects.instance [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'flavor' on Instance uuid 01f7b533-1825-4ea5-a580-7f6442e3630e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:56:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:56:59 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:56:59 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:56:59 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:56:59 user nova-compute[75258]:   <serial>2b720084-2557-46c6-9ebb-a5b7f44b1636</serial>
Nov 14 12:56:59 user nova-compute[75258]: </disk>
Nov 14 12:56:59 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:57:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:57:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:57:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] No VIF found with MAC fa:16:3e:f2:c7:70, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:57:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-405a2e29-7d6d-4ab8-b9fb-469b0bf45af1 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.320s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:01 user nova-compute[75258]: INFO nova.compute.manager [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Detaching volume 2b720084-2557-46c6-9ebb-a5b7f44b1636
Nov 14 12:57:01 user nova-compute[75258]: INFO nova.virt.block_device [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Attempting to driver detach volume 2b720084-2557-46c6-9ebb-a5b7f44b1636 from mountpoint /dev/vdb
Nov 14 12:57:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Attempting to detach device vdb from instance 01f7b533-1825-4ea5-a580-7f6442e3630e from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:57:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:57:01 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:57:01 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:57:01 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:57:01 user nova-compute[75258]:   <serial>2b720084-2557-46c6-9ebb-a5b7f44b1636</serial>
Nov 14 12:57:01 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:57:01 user nova-compute[75258]: </disk>
Nov 14 12:57:01 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:57:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully detached device vdb from instance 01f7b533-1825-4ea5-a580-7f6442e3630e from the persistent domain config.
Nov 14 12:57:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 01f7b533-1825-4ea5-a580-7f6442e3630e from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:57:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:57:01 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:57:01 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:57:01 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:57:01 user nova-compute[75258]:   <serial>2b720084-2557-46c6-9ebb-a5b7f44b1636</serial>
Nov 14 12:57:01 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:57:01 user nova-compute[75258]: </disk>
Nov 14 12:57:01 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:57:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 01f7b533-1825-4ea5-a580-7f6442e3630e {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:57:15 user nova-compute[75258]: INFO nova.compute.claims [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Claim successful on node user
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.333s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.network.neutron [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:57:15 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:57:15 user nova-compute[75258]: DEBUG nova.policy [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d957bc3f2cf4beb931c5796ce2a4c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c080a084f2b8483894a1904531d152ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:57:16 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Creating image(s)
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "/opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk 1073741824" returned: 0 in 0.056s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Successfully created port: 51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Cannot resize image /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Ensure instance console log exists: /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Successfully updated port: 51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquired lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-changed-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Refreshing instance network info cache due to event network-changed-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] Acquiring lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updating instance_info_cache with network_info: [{"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Releasing lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Instance network_info: |[{"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] Acquired lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Refreshing network info cache for port 51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Start _get_guest_xml network_info=[{"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:57:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2014533456',display_name='tempest-AttachVolumeNegativeTest-server-2014533456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2014533456',id=35,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUo/KZKQ+/hpwzl8DX4nIg7lQ6d2LJCyGDLQS+tzigcrFA8sLM8ewJKkkNnWRGNPy85oCaIemEag1uAtjMXjUAs2hXLQIAM5LkqdyGBVr9cbQb033YcaBUHnSs+aG8A2w==',key_name='tempest-keypair-1916589535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-0oetm10m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=3f9dc56b-c8db-4555-b4c3-9a3e2860309b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:88:ab,bridge_name='br-int',has_traffic_filtering=True,id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cf7a33-57') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'pci_devices' on Instance uuid 3f9dc56b-c8db-4555-b4c3-9a3e2860309b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:57:18 user nova-compute[75258]:   <uuid>3f9dc56b-c8db-4555-b4c3-9a3e2860309b</uuid>
Nov 14 12:57:18 user nova-compute[75258]:   <name>instance-00000023</name>
Nov 14 12:57:18 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:57:18 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:57:18 user nova-compute[75258]:   <metadata>
Nov 14 12:57:18 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:57:18 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:57:18 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-2014533456</nova:name>
Nov 14 12:57:18 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:57:18</nova:creationTime>
Nov 14 12:57:18 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:57:18 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:57:18 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:57:18 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:57:18 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:57:18 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:57:18 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:57:18 user nova-compute[75258]:       <nova:owner>
Nov 14 12:57:18 user nova-compute[75258]:         <nova:user uuid="0d957bc3f2cf4beb931c5796ce2a4c42">tempest-AttachVolumeNegativeTest-694932868-project-member</nova:user>
Nov 14 12:57:18 user nova-compute[75258]:         <nova:project uuid="c080a084f2b8483894a1904531d152ca">tempest-AttachVolumeNegativeTest-694932868</nova:project>
Nov 14 12:57:18 user nova-compute[75258]:       </nova:owner>
Nov 14 12:57:18 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:57:18 user nova-compute[75258]:       <nova:ports>
Nov 14 12:57:18 user nova-compute[75258]:         <nova:port uuid="51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d">
Nov 14 12:57:18 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 12:57:18 user nova-compute[75258]:         </nova:port>
Nov 14 12:57:18 user nova-compute[75258]:       </nova:ports>
Nov 14 12:57:18 user nova-compute[75258]:     </nova:instance>
Nov 14 12:57:18 user nova-compute[75258]:   </metadata>
Nov 14 12:57:18 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:57:18 user nova-compute[75258]:     <system>
Nov 14 12:57:18 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:57:18 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:57:18 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:57:18 user nova-compute[75258]:       <entry name="serial">3f9dc56b-c8db-4555-b4c3-9a3e2860309b</entry>
Nov 14 12:57:18 user nova-compute[75258]:       <entry name="uuid">3f9dc56b-c8db-4555-b4c3-9a3e2860309b</entry>
Nov 14 12:57:18 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:57:18 user nova-compute[75258]:     </system>
Nov 14 12:57:18 user nova-compute[75258]:   </sysinfo>
Nov 14 12:57:18 user nova-compute[75258]:   <os>
Nov 14 12:57:18 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:57:18 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:57:18 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:57:18 user nova-compute[75258]:   </os>
Nov 14 12:57:18 user nova-compute[75258]:   <features>
Nov 14 12:57:18 user nova-compute[75258]:     <acpi/>
Nov 14 12:57:18 user nova-compute[75258]:     <apic/>
Nov 14 12:57:18 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:57:18 user nova-compute[75258]:   </features>
Nov 14 12:57:18 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:57:18 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:57:18 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:57:18 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:57:18 user nova-compute[75258]:   </clock>
Nov 14 12:57:18 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:57:18 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:57:18 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:57:18 user nova-compute[75258]:   </cpu>
Nov 14 12:57:18 user nova-compute[75258]:   <devices>
Nov 14 12:57:18 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:57:18 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:57:18 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk"/>
Nov 14 12:57:18 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:57:18 user nova-compute[75258]:     </disk>
Nov 14 12:57:18 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:57:18 user nova-compute[75258]:       <mac address="fa:16:3e:e3:88:ab"/>
Nov 14 12:57:18 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:57:18 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:57:18 user nova-compute[75258]:       <target dev="tap51cf7a33-57"/>
Nov 14 12:57:18 user nova-compute[75258]:     </interface>
Nov 14 12:57:18 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:57:18 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/console.log" append="off"/>
Nov 14 12:57:18 user nova-compute[75258]:     </serial>
Nov 14 12:57:18 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:57:18 user nova-compute[75258]:     <video>
Nov 14 12:57:18 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:57:18 user nova-compute[75258]:     </video>
Nov 14 12:57:18 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:57:18 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:57:18 user nova-compute[75258]:     </rng>
Nov 14 12:57:18 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:57:18 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:57:18 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:57:18 user nova-compute[75258]:     </memballoon>
Nov 14 12:57:18 user nova-compute[75258]:   </devices>
Nov 14 12:57:18 user nova-compute[75258]: </domain>
Nov 14 12:57:18 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2014533456',display_name='tempest-AttachVolumeNegativeTest-server-2014533456',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2014533456',id=35,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUo/KZKQ+/hpwzl8DX4nIg7lQ6d2LJCyGDLQS+tzigcrFA8sLM8ewJKkkNnWRGNPy85oCaIemEag1uAtjMXjUAs2hXLQIAM5LkqdyGBVr9cbQb033YcaBUHnSs+aG8A2w==',key_name='tempest-keypair-1916589535',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-0oetm10m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:57:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=3f9dc56b-c8db-4555-b4c3-9a3e2860309b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e3:88:ab,bridge_name='br-int',has_traffic_filtering=True,id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cf7a33-57') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG os_vif [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:88:ab,bridge_name='br-int',has_traffic_filtering=True,id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cf7a33-57') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7b718896-331f-5159-9d81-88e44a613017', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51cf7a33-57, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap51cf7a33-57, col_values=(('qos', UUID('6723b3f4-9bbc-4fb4-a1cf-668930bbeb86')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap51cf7a33-57, col_values=(('external_ids', {'iface-id': '51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e3:88:ab', 'vm-uuid': '3f9dc56b-c8db-4555-b4c3-9a3e2860309b'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:18 user nova-compute[75258]: INFO os_vif [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e3:88:ab,bridge_name='br-int',has_traffic_filtering=True,id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cf7a33-57')
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No VIF found with MAC fa:16:3e:e3:88:ab, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updated VIF entry in instance network info cache for port 51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updating instance_info_cache with network_info: [{"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab3cf544-374f-4e90-9954-75fe408390e2 req-07da922b-26a4-4bd9-b59b-c3c3b9bc6d5b service nova] Releasing lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG nova.compute.manager [req-e00d6870-b306-48dd-b908-955902fcc0fc req-ce00b3a0-c4c4-48e1-9660-5461a882e5ec service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e00d6870-b306-48dd-b908-955902fcc0fc req-ce00b3a0-c4c4-48e1-9660-5461a882e5ec service nova] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e00d6870-b306-48dd-b908-955902fcc0fc req-ce00b3a0-c4c4-48e1-9660-5461a882e5ec service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e00d6870-b306-48dd-b908-955902fcc0fc req-ce00b3a0-c4c4-48e1-9660-5461a882e5ec service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:19 user nova-compute[75258]: DEBUG nova.compute.manager [req-e00d6870-b306-48dd-b908-955902fcc0fc req-ce00b3a0-c4c4-48e1-9660-5461a882e5ec service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] No waiting events found dispatching network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:19 user nova-compute[75258]: WARNING nova.compute.manager [req-e00d6870-b306-48dd-b908-955902fcc0fc req-ce00b3a0-c4c4-48e1-9660-5461a882e5ec service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received unexpected event network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d for instance with vm_state building and task_state spawning.
Nov 14 12:57:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updating instance_info_cache with network_info: [{"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:57:21 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Instance spawned successfully.
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:21 user nova-compute[75258]: INFO nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Took 5.87 seconds to spawn the instance on the hypervisor.
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-814e94b0-35ce-471b-8aee-3434b9439435 req-784afc74-6e2e-45d1-955e-a76a4a8384ac service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-814e94b0-35ce-471b-8aee-3434b9439435 req-784afc74-6e2e-45d1-955e-a76a4a8384ac service nova] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-814e94b0-35ce-471b-8aee-3434b9439435 req-784afc74-6e2e-45d1-955e-a76a4a8384ac service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-814e94b0-35ce-471b-8aee-3434b9439435 req-784afc74-6e2e-45d1-955e-a76a4a8384ac service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-814e94b0-35ce-471b-8aee-3434b9439435 req-784afc74-6e2e-45d1-955e-a76a4a8384ac service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] No waiting events found dispatching network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:21 user nova-compute[75258]: WARNING nova.compute.manager [req-814e94b0-35ce-471b-8aee-3434b9439435 req-784afc74-6e2e-45d1-955e-a76a4a8384ac service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received unexpected event network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d for instance with vm_state building and task_state spawning.
Nov 14 12:57:22 user nova-compute[75258]: INFO nova.compute.manager [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Took 6.57 seconds to build instance.
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74b777e6-bb01-4fc9-a77c-fa31c37d3db9 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.671s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:22 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 01f7b533-1825-4ea5-a580-7f6442e3630e is timed out.
Nov 14 12:57:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully detached device vdb from instance 01f7b533-1825-4ea5-a580-7f6442e3630e from the live domain config.
Nov 14 12:57:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MXszwZHJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:57:22 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a26bb7dc-07d1-4c23-98cf-fd41cd21e0c0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:57:22 user nova-compute[75258]: No targets found.
Nov 14 12:57:22 user nova-compute[75258]: iSNS:
Nov 14 12:57:22 user nova-compute[75258]: No targets found.
Nov 14 12:57:22 user nova-compute[75258]: STATIC:
Nov 14 12:57:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:57:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:57:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:57:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636
Nov 14 12:57:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:57:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:57:22 user nova-compute[75258]: FIRMWARE:
Nov 14 12:57:22 user nova-compute[75258]: No targets found.
Nov 14 12:57:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:57:22 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:57:22 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce03776-047e-4f03-9e0e-1a6fb862efaf]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5e74b0-4790-4c45-bd75-ee7ecfd44e8c]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:57:22 user nova-compute[75258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 (non-flash)
Nov 14 12:57:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:57:22 user nova-compute[75258]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 (non-flash)
Nov 14 12:57:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c78cc10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9076cf19-6197-4b57-b642-faaf9169ec8b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8fa9edb-c39e-4059-abf0-f5381724e978]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c494b22c-c919-47a4-aacf-02ceb3e3b702]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6817d66e-2d76-4ec5-949d-65f2c43022f6]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f4b1d28-0003-46dd-a3ef-4b7002999479]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbe8881-954b-45e4-9b49-154ace4201fd]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260]
Nov 14 12:57:22 user nova-compute[75258]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636, portal: 172.16.0.220,3260] successful.
Nov 14 12:57:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2b720084-2557-46c6-9ebb-a5b7f44b1636 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d0f9f6-325e-4236-a756-dd06fc3adc18]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] <== disconnect_volume: return (293ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:57:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:57:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'flavor' on Instance uuid 01f7b533-1825-4ea5-a580-7f6442e3630e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:57:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-140bb9b6-6e41-4667-85bf-ebc271df7c23 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.794s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:28 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:28 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8484MB free_disk=25.080310821533203GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Applying migration context for instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 as it has an incoming, in-progress migration ea4cf80c-dc99-4c24-b460-41040d9d3796. Migration status is finished {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Nov 14 12:57:28 user nova-compute[75258]: INFO nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating resource usage from migration ea4cf80c-dc99-4c24-b460-41040d9d3796
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 655df082-9b52-4bf6-8de5-e98f500e7454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 01f7b533-1825-4ea5-a580-7f6442e3630e actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Migration ea4cf80c-dc99-4c24-b460-41040d9d3796 is active on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:57:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.367s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Going to confirm migration 2 {{(pid=75258) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4774}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquired lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'info_cache' on Instance uuid a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Releasing lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'migration_context' on Instance uuid a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG nova.objects.base [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Object Instance<a7b11d71-ee0a-47e0-a1e2-2206f0be1b46> lazy-loaded attributes: info_cache,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:57:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:57:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.280s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:31 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Deleted allocation for migration ea4cf80c-dc99-4c24-b460-41040d9d3796
Nov 14 12:57:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a725a50d-181c-4d77-ad12-f66b47292db5 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.421s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 12:57:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 12:57:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:57:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 12:57:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:57:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:38 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:57:38 user nova-compute[75258]: INFO nova.compute.claims [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Claim successful on node user
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.279s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:57:39 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.policy [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ce04af2bfa934429abfe2c01e783ef6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93e782e5dc7c4b778282830cd303b76a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:57:39 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Creating image(s)
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "/opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "/opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "/opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk 1073741824" returned: 0 in 0.050s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.243s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Successfully created port: 25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Checking if we can resize image /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:57:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Cannot resize image /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Ensure instance console log exists: /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Successfully updated port: 25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquired lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-changed-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Refreshing instance network info cache due to event network-changed-25435b71-a918-4767-a996-4c92921df551. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] Acquiring lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updating instance_info_cache with network_info: [{"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Releasing lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Instance network_info: |[{"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] Acquired lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.neutron [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Refreshing network info cache for port 25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Start _get_guest_xml network_info=[{"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:57:40 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:40 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-930041350',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-930041350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9300413',id=36,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkXUSIjMMgLeAfPOyU3t+L+9p7z5VIWrh+wjbk8o37jUYZNtW1SCM+fVzxWcrmst6suz5ebS4mf06jrxSodvV3BDNWroWMrGcn9QiQH6wmwR3pmwzGwsWDWVU0AtNfFfA==',key_name='tempest-keypair-2010265157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93e782e5dc7c4b778282830cd303b76a',ramdisk_id='',reservation_id='r-qp9emtbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-600757002',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce04af2bfa934429abfe2c01e783ef6f',uuid=71591c79-60f9-4efd-a01d-9e824bb2255a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Converting VIF {"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8e:c1,bridge_name='br-int',has_traffic_filtering=True,id=25435b71-a918-4767-a996-4c92921df551,network=Network(2bb2ada5-d151-40e2-b291-0ed7b8da10ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25435b71-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.objects.instance [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lazy-loading 'pci_devices' on Instance uuid 71591c79-60f9-4efd-a01d-9e824bb2255a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:57:40 user nova-compute[75258]:   <uuid>71591c79-60f9-4efd-a01d-9e824bb2255a</uuid>
Nov 14 12:57:40 user nova-compute[75258]:   <name>instance-00000024</name>
Nov 14 12:57:40 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:57:40 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:57:40 user nova-compute[75258]:   <metadata>
Nov 14 12:57:40 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:57:40 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:57:40 user nova-compute[75258]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-930041350</nova:name>
Nov 14 12:57:40 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:57:40</nova:creationTime>
Nov 14 12:57:40 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:57:40 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:57:40 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:57:40 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:57:40 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:57:40 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:57:40 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:57:40 user nova-compute[75258]:       <nova:owner>
Nov 14 12:57:40 user nova-compute[75258]:         <nova:user uuid="ce04af2bfa934429abfe2c01e783ef6f">tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member</nova:user>
Nov 14 12:57:40 user nova-compute[75258]:         <nova:project uuid="93e782e5dc7c4b778282830cd303b76a">tempest-TestServerVolumeAttachScenarioOldVersion-600757002</nova:project>
Nov 14 12:57:40 user nova-compute[75258]:       </nova:owner>
Nov 14 12:57:40 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:57:40 user nova-compute[75258]:       <nova:ports>
Nov 14 12:57:40 user nova-compute[75258]:         <nova:port uuid="25435b71-a918-4767-a996-4c92921df551">
Nov 14 12:57:40 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Nov 14 12:57:40 user nova-compute[75258]:         </nova:port>
Nov 14 12:57:40 user nova-compute[75258]:       </nova:ports>
Nov 14 12:57:40 user nova-compute[75258]:     </nova:instance>
Nov 14 12:57:40 user nova-compute[75258]:   </metadata>
Nov 14 12:57:40 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:57:40 user nova-compute[75258]:     <system>
Nov 14 12:57:40 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:57:40 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:57:40 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:57:40 user nova-compute[75258]:       <entry name="serial">71591c79-60f9-4efd-a01d-9e824bb2255a</entry>
Nov 14 12:57:40 user nova-compute[75258]:       <entry name="uuid">71591c79-60f9-4efd-a01d-9e824bb2255a</entry>
Nov 14 12:57:40 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:57:40 user nova-compute[75258]:     </system>
Nov 14 12:57:40 user nova-compute[75258]:   </sysinfo>
Nov 14 12:57:40 user nova-compute[75258]:   <os>
Nov 14 12:57:40 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:57:40 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:57:40 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:57:40 user nova-compute[75258]:   </os>
Nov 14 12:57:40 user nova-compute[75258]:   <features>
Nov 14 12:57:40 user nova-compute[75258]:     <acpi/>
Nov 14 12:57:40 user nova-compute[75258]:     <apic/>
Nov 14 12:57:40 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:57:40 user nova-compute[75258]:   </features>
Nov 14 12:57:40 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:57:40 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:57:40 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:57:40 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:57:40 user nova-compute[75258]:   </clock>
Nov 14 12:57:40 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:57:40 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:57:40 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:57:40 user nova-compute[75258]:   </cpu>
Nov 14 12:57:40 user nova-compute[75258]:   <devices>
Nov 14 12:57:40 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:57:40 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:57:40 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk"/>
Nov 14 12:57:40 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:57:40 user nova-compute[75258]:     </disk>
Nov 14 12:57:40 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:57:40 user nova-compute[75258]:       <mac address="fa:16:3e:a8:8e:c1"/>
Nov 14 12:57:40 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:57:40 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:57:40 user nova-compute[75258]:       <target dev="tap25435b71-a9"/>
Nov 14 12:57:40 user nova-compute[75258]:     </interface>
Nov 14 12:57:40 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:57:40 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/console.log" append="off"/>
Nov 14 12:57:40 user nova-compute[75258]:     </serial>
Nov 14 12:57:40 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:57:40 user nova-compute[75258]:     <video>
Nov 14 12:57:40 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:57:40 user nova-compute[75258]:     </video>
Nov 14 12:57:40 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:57:40 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:57:40 user nova-compute[75258]:     </rng>
Nov 14 12:57:40 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:57:40 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:57:40 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:57:40 user nova-compute[75258]:     </memballoon>
Nov 14 12:57:40 user nova-compute[75258]:   </devices>
Nov 14 12:57:40 user nova-compute[75258]: </domain>
Nov 14 12:57:40 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-930041350',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-930041350',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9300413',id=36,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkXUSIjMMgLeAfPOyU3t+L+9p7z5VIWrh+wjbk8o37jUYZNtW1SCM+fVzxWcrmst6suz5ebS4mf06jrxSodvV3BDNWroWMrGcn9QiQH6wmwR3pmwzGwsWDWVU0AtNfFfA==',key_name='tempest-keypair-2010265157',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93e782e5dc7c4b778282830cd303b76a',ramdisk_id='',reservation_id='r-qp9emtbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-600757002',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:57:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce04af2bfa934429abfe2c01e783ef6f',uuid=71591c79-60f9-4efd-a01d-9e824bb2255a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Converting VIF {"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8e:c1,bridge_name='br-int',has_traffic_filtering=True,id=25435b71-a918-4767-a996-4c92921df551,network=Network(2bb2ada5-d151-40e2-b291-0ed7b8da10ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25435b71-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG os_vif [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8e:c1,bridge_name='br-int',has_traffic_filtering=True,id=25435b71-a918-4767-a996-4c92921df551,network=Network(2bb2ada5-d151-40e2-b291-0ed7b8da10ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25435b71-a9') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c1f4646e-9e9a-53fc-88dc-2738de866d9d', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap25435b71-a9, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap25435b71-a9, col_values=(('qos', UUID('7e4a91e0-8a6b-41df-b235-0e34aa96d9ab')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap25435b71-a9, col_values=(('external_ids', {'iface-id': '25435b71-a918-4767-a996-4c92921df551', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a8:8e:c1', 'vm-uuid': '71591c79-60f9-4efd-a01d-9e824bb2255a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:40 user nova-compute[75258]: INFO os_vif [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a8:8e:c1,bridge_name='br-int',has_traffic_filtering=True,id=25435b71-a918-4767-a996-4c92921df551,network=Network(2bb2ada5-d151-40e2-b291-0ed7b8da10ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25435b71-a9')
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:57:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] No VIF found with MAC fa:16:3e:a8:8e:c1, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:57:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updated VIF entry in instance network info cache for port 25435b71-a918-4767-a996-4c92921df551. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:57:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updating instance_info_cache with network_info: [{"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c0b555c7-cf01-476b-accf-0eb2425ec0ca req-21eee805-c5e6-47f0-9f54-6b2028f24320 service nova] Releasing lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-5afc3e5f-ff2c-430b-8d21-11c7feda331c req-13cb0d1f-f3d3-484c-a315-fb6b35d5836d service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5afc3e5f-ff2c-430b-8d21-11c7feda331c req-13cb0d1f-f3d3-484c-a315-fb6b35d5836d service nova] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5afc3e5f-ff2c-430b-8d21-11c7feda331c req-13cb0d1f-f3d3-484c-a315-fb6b35d5836d service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5afc3e5f-ff2c-430b-8d21-11c7feda331c req-13cb0d1f-f3d3-484c-a315-fb6b35d5836d service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-5afc3e5f-ff2c-430b-8d21-11c7feda331c req-13cb0d1f-f3d3-484c-a315-fb6b35d5836d service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] No waiting events found dispatching network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:42 user nova-compute[75258]: WARNING nova.compute.manager [req-5afc3e5f-ff2c-430b-8d21-11c7feda331c req-13cb0d1f-f3d3-484c-a315-fb6b35d5836d service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received unexpected event network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 for instance with vm_state building and task_state spawning.
Nov 14 12:57:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:57:44 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Instance spawned successfully.
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:44 user nova-compute[75258]: INFO nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Took 5.29 seconds to spawn the instance on the hypervisor.
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-80683d21-059f-4961-b181-2214af71b7f1 req-89118709-3465-43e7-85ba-bc7aacf363e9 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-80683d21-059f-4961-b181-2214af71b7f1 req-89118709-3465-43e7-85ba-bc7aacf363e9 service nova] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-80683d21-059f-4961-b181-2214af71b7f1 req-89118709-3465-43e7-85ba-bc7aacf363e9 service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-80683d21-059f-4961-b181-2214af71b7f1 req-89118709-3465-43e7-85ba-bc7aacf363e9 service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG nova.compute.manager [req-80683d21-059f-4961-b181-2214af71b7f1 req-89118709-3465-43e7-85ba-bc7aacf363e9 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] No waiting events found dispatching network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:44 user nova-compute[75258]: WARNING nova.compute.manager [req-80683d21-059f-4961-b181-2214af71b7f1 req-89118709-3465-43e7-85ba-bc7aacf363e9 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received unexpected event network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 for instance with vm_state building and task_state spawning.
Nov 14 12:57:44 user nova-compute[75258]: INFO nova.compute.manager [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Took 5.93 seconds to build instance.
Nov 14 12:57:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-18a8b437-2b96-48f1-91cb-dda45b50095c tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.024s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-changed-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Refreshing instance network info cache due to event network-changed-7cd0b4a2-0562-45c8-a9bf-23a3210f1506. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] Acquiring lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] Acquired lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Refreshing network info cache for port 7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:52 user nova-compute[75258]: INFO nova.compute.manager [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Terminating instance
Nov 14 12:57:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updated VIF entry in instance network info cache for port 7cd0b4a2-0562-45c8-a9bf-23a3210f1506. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG nova.network.neutron [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updating instance_info_cache with network_info: [{"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-daed575b-a4b3-45df-b36b-cc18d410fae4 req-a64cf8ea-bede-469f-a9a9-8dff6089b86f service nova] Releasing lock "refresh_cache-01f7b533-1825-4ea5-a580-7f6442e3630e" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Instance destroyed successfully.
Nov 14 12:57:53 user nova-compute[75258]: DEBUG nova.objects.instance [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'resources' on Instance uuid 01f7b533-1825-4ea5-a580-7f6442e3630e {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:55:00Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-579689660',display_name='tempest-TestStampPattern-server-579689660',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-579689660',id=34,image_ref='e19729da-5aa4-42d1-9200-9a7692f675c4',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jpfwPDiaw/GQ227J0mNoSTCU3OtL4gaaSJfLmw6zipgxzksWqHCtyLbWdzoVaIm0VPX7LvotObrlI//TM1p6iFvBovNg/Llgf/G+LW/rsG9r3i/SqUfLRUo5ZiUWfzQ==',key_name='tempest-TestStampPattern-1020160408',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:55:07Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abcfbbc31fe74017ba6be81499ff7592',ramdisk_id='',reservation_id='r-k6mcd76n',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='655df082-9b52-4bf6-8de5-e98f500e7454',image_min_disk='1',image_min_ram='0',image_owner_id='abcfbbc31fe74017ba6be81499ff7592',image_owner_project_name='tempest-TestStampPattern-253582314',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-253582314-project-member',image_user_id='24ce11c0aea848fcbe316b293ceecdf7',owner_project_name='tempest-TestStampPattern-253582314',owner_user_name='tempest-TestStampPattern-253582314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:55:08Z,user_data=None,user_id='24ce11c0aea848fcbe316b293ceecdf7',uuid=01f7b533-1825-4ea5-a580-7f6442e3630e,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converting VIF {"id": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "address": "fa:16:3e:f2:c7:70", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.145", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7cd0b4a2-05", "ovs_interfaceid": "7cd0b4a2-0562-45c8-a9bf-23a3210f1506", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=7cd0b4a2-0562-45c8-a9bf-23a3210f1506,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd0b4a2-05') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG os_vif [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=7cd0b4a2-0562-45c8-a9bf-23a3210f1506,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd0b4a2-05') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7cd0b4a2-05, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=d648198c-36f4-4d50-b587-b4832b73fa95) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: INFO os_vif [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:c7:70,bridge_name='br-int',has_traffic_filtering=True,id=7cd0b4a2-0562-45c8-a9bf-23a3210f1506,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7cd0b4a2-05')
Nov 14 12:57:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Deleting instance files /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e_del
Nov 14 12:57:53 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Deletion of /opt/stack/data/nova/instances/01f7b533-1825-4ea5-a580-7f6442e3630e_del complete
Nov 14 12:57:53 user nova-compute[75258]: INFO nova.compute.manager [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 12:57:53 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:53 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:57:54 user nova-compute[75258]: INFO nova.compute.claims [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Claim successful on node user
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.339s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:54 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Took 0.99 seconds to deallocate network for instance.
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.network.neutron [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:57:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-vif-unplugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] No waiting events found dispatching network-vif-unplugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-vif-unplugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] Acquiring lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] No waiting events found dispatching network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:54 user nova-compute[75258]: WARNING nova.compute.manager [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received unexpected event network-vif-plugged-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 for instance with vm_state active and task_state deleting.
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-42693451-5a7f-4073-b52b-f03879abb35f req-2ae81588-7559-49ee-bf1d-65dfebda4e5f service nova] [instance: 01f7b533-1825-4ea5-a580-7f6442e3630e] Received event network-vif-deleted-7cd0b4a2-0562-45c8-a9bf-23a3210f1506 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.policy [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efce5644ae184c458b7fe8e3ef4c66da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb1c380db14d12848d79ba9982681c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:57:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Creating image(s)
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "/opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "/opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "/opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.475s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:55 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Deleted allocations for instance 01f7b533-1825-4ea5-a580-7f6442e3630e
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk 1073741824" returned: 0 in 0.060s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Successfully created port: f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d1764c2f-019a-4b65-b18c-c732597804a3 tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "01f7b533-1825-4ea5-a580-7f6442e3630e" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.663s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Cannot resize image /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Ensure instance console log exists: /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Successfully updated port: f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquired lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updating instance_info_cache with network_info: [{"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Releasing lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Instance network_info: |[{"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Start _get_guest_xml network_info=[{"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:57:55 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:55 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:57:55 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2031771365',display_name='tempest-ServersNegativeTestJSON-server-2031771365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2031771365',id=37,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25cb1c380db14d12848d79ba9982681c',ramdisk_id='',reservation_id='r-0tp44o7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-8951680',owner_user_name='tempest-ServersNegativeTestJSON-8951680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:57:55Z,user_data=None,user_id='efce5644ae184c458b7fe8e3ef4c66da',uuid=2bfe5292-6dc9-4b4d-980b-38e18cd593c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converting VIF {"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf799e0c5-98') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.objects.instance [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lazy-loading 'pci_devices' on Instance uuid 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:57:56 user nova-compute[75258]:   <uuid>2bfe5292-6dc9-4b4d-980b-38e18cd593c9</uuid>
Nov 14 12:57:56 user nova-compute[75258]:   <name>instance-00000025</name>
Nov 14 12:57:56 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:57:56 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:57:56 user nova-compute[75258]:   <metadata>
Nov 14 12:57:56 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:57:56 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:57:56 user nova-compute[75258]:       <nova:name>tempest-ServersNegativeTestJSON-server-2031771365</nova:name>
Nov 14 12:57:56 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:57:55</nova:creationTime>
Nov 14 12:57:56 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:57:56 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:57:56 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:57:56 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:57:56 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:57:56 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:57:56 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:57:56 user nova-compute[75258]:       <nova:owner>
Nov 14 12:57:56 user nova-compute[75258]:         <nova:user uuid="efce5644ae184c458b7fe8e3ef4c66da">tempest-ServersNegativeTestJSON-8951680-project-member</nova:user>
Nov 14 12:57:56 user nova-compute[75258]:         <nova:project uuid="25cb1c380db14d12848d79ba9982681c">tempest-ServersNegativeTestJSON-8951680</nova:project>
Nov 14 12:57:56 user nova-compute[75258]:       </nova:owner>
Nov 14 12:57:56 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:57:56 user nova-compute[75258]:       <nova:ports>
Nov 14 12:57:56 user nova-compute[75258]:         <nova:port uuid="f799e0c5-981a-4bea-a2a5-7d8fc204ad81">
Nov 14 12:57:56 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 12:57:56 user nova-compute[75258]:         </nova:port>
Nov 14 12:57:56 user nova-compute[75258]:       </nova:ports>
Nov 14 12:57:56 user nova-compute[75258]:     </nova:instance>
Nov 14 12:57:56 user nova-compute[75258]:   </metadata>
Nov 14 12:57:56 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:57:56 user nova-compute[75258]:     <system>
Nov 14 12:57:56 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:57:56 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:57:56 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:57:56 user nova-compute[75258]:       <entry name="serial">2bfe5292-6dc9-4b4d-980b-38e18cd593c9</entry>
Nov 14 12:57:56 user nova-compute[75258]:       <entry name="uuid">2bfe5292-6dc9-4b4d-980b-38e18cd593c9</entry>
Nov 14 12:57:56 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:57:56 user nova-compute[75258]:     </system>
Nov 14 12:57:56 user nova-compute[75258]:   </sysinfo>
Nov 14 12:57:56 user nova-compute[75258]:   <os>
Nov 14 12:57:56 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:57:56 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:57:56 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:57:56 user nova-compute[75258]:   </os>
Nov 14 12:57:56 user nova-compute[75258]:   <features>
Nov 14 12:57:56 user nova-compute[75258]:     <acpi/>
Nov 14 12:57:56 user nova-compute[75258]:     <apic/>
Nov 14 12:57:56 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:57:56 user nova-compute[75258]:   </features>
Nov 14 12:57:56 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:57:56 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:57:56 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:57:56 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:57:56 user nova-compute[75258]:   </clock>
Nov 14 12:57:56 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:57:56 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:57:56 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:57:56 user nova-compute[75258]:   </cpu>
Nov 14 12:57:56 user nova-compute[75258]:   <devices>
Nov 14 12:57:56 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:57:56 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:57:56 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk"/>
Nov 14 12:57:56 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:57:56 user nova-compute[75258]:     </disk>
Nov 14 12:57:56 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:57:56 user nova-compute[75258]:       <mac address="fa:16:3e:f0:fb:d2"/>
Nov 14 12:57:56 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:57:56 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:57:56 user nova-compute[75258]:       <target dev="tapf799e0c5-98"/>
Nov 14 12:57:56 user nova-compute[75258]:     </interface>
Nov 14 12:57:56 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:57:56 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/console.log" append="off"/>
Nov 14 12:57:56 user nova-compute[75258]:     </serial>
Nov 14 12:57:56 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:57:56 user nova-compute[75258]:     <video>
Nov 14 12:57:56 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:57:56 user nova-compute[75258]:     </video>
Nov 14 12:57:56 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:57:56 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:57:56 user nova-compute[75258]:     </rng>
Nov 14 12:57:56 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:57:56 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:57:56 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:57:56 user nova-compute[75258]:     </memballoon>
Nov 14 12:57:56 user nova-compute[75258]:   </devices>
Nov 14 12:57:56 user nova-compute[75258]: </domain>
Nov 14 12:57:56 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2031771365',display_name='tempest-ServersNegativeTestJSON-server-2031771365',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2031771365',id=37,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25cb1c380db14d12848d79ba9982681c',ramdisk_id='',reservation_id='r-0tp44o7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-8951680',owner_user_name='tempest-ServersNegativeTestJSON-8951680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:57:55Z,user_data=None,user_id='efce5644ae184c458b7fe8e3ef4c66da',uuid=2bfe5292-6dc9-4b4d-980b-38e18cd593c9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converting VIF {"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf799e0c5-98') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG os_vif [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf799e0c5-98') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3974596e-77a7-5308-93d6-8c4a8d186dfa', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf799e0c5-98, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf799e0c5-98, col_values=(('qos', UUID('b4242fa3-4e7f-42a3-bf5f-b26137153d38')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf799e0c5-98, col_values=(('external_ids', {'iface-id': 'f799e0c5-981a-4bea-a2a5-7d8fc204ad81', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:fb:d2', 'vm-uuid': '2bfe5292-6dc9-4b4d-980b-38e18cd593c9'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:56 user nova-compute[75258]: INFO os_vif [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf799e0c5-98')
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] No VIF found with MAC fa:16:3e:f0:fb:d2, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received event network-changed-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Refreshing instance network info cache due to event network-changed-f799e0c5-981a-4bea-a2a5-7d8fc204ad81. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] Acquiring lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] Acquired lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.network.neutron [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Refreshing network info cache for port f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.network.neutron [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updated VIF entry in instance network info cache for port f799e0c5-981a-4bea-a2a5-7d8fc204ad81. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG nova.network.neutron [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updating instance_info_cache with network_info: [{"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:57:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-176cef71-59a6-4531-8bc1-51c4f61665ae req-70f1048c-093a-46c6-bd35-3b117c38fb33 service nova] Releasing lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-0fb0eb41-def8-4943-827f-9e8d55bfc0e0 req-cb9793cb-b0cc-4830-b67e-c12f4509ffcd service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received event network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0fb0eb41-def8-4943-827f-9e8d55bfc0e0 req-cb9793cb-b0cc-4830-b67e-c12f4509ffcd service nova] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0fb0eb41-def8-4943-827f-9e8d55bfc0e0 req-cb9793cb-b0cc-4830-b67e-c12f4509ffcd service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0fb0eb41-def8-4943-827f-9e8d55bfc0e0 req-cb9793cb-b0cc-4830-b67e-c12f4509ffcd service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-0fb0eb41-def8-4943-827f-9e8d55bfc0e0 req-cb9793cb-b0cc-4830-b67e-c12f4509ffcd service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] No waiting events found dispatching network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:57 user nova-compute[75258]: WARNING nova.compute.manager [req-0fb0eb41-def8-4943-827f-9e8d55bfc0e0 req-cb9793cb-b0cc-4830-b67e-c12f4509ffcd service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received unexpected event network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 for instance with vm_state building and task_state spawning.
Nov 14 12:57:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:57:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Instance spawned successfully.
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:57:59 user nova-compute[75258]: INFO nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Took 4.96 seconds to spawn the instance on the hypervisor.
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:57:59 user nova-compute[75258]: INFO nova.compute.manager [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Took 5.63 seconds to build instance.
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-083467d2-3494-4788-b619-b30fae1988c1 req-946a9728-a3c8-4436-b0f0-c3333b70786a service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received event network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-083467d2-3494-4788-b619-b30fae1988c1 req-946a9728-a3c8-4436-b0f0-c3333b70786a service nova] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-083467d2-3494-4788-b619-b30fae1988c1 req-946a9728-a3c8-4436-b0f0-c3333b70786a service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-083467d2-3494-4788-b619-b30fae1988c1 req-946a9728-a3c8-4436-b0f0-c3333b70786a service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-083467d2-3494-4788-b619-b30fae1988c1 req-946a9728-a3c8-4436-b0f0-c3333b70786a service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] No waiting events found dispatching network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:57:59 user nova-compute[75258]: WARNING nova.compute.manager [req-083467d2-3494-4788-b619-b30fae1988c1 req-946a9728-a3c8-4436-b0f0-c3333b70786a service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received unexpected event network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 for instance with vm_state active and task_state None.
Nov 14 12:57:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-cb7626fd-b2c5-4ad5-a0dc-b234bfb7d1b3 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.738s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:57:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:58:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 12:58:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:58:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:58:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8200MB free_disk=24.985916137695312GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 655df082-9b52-4bf6-8de5-e98f500e7454 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 71591c79-60f9-4efd-a01d-9e824bb2255a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 6 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=6 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:58:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.609s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:58:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:58:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:58:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-changed-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Refreshing instance network info cache due to event network-changed-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] Acquiring lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] Acquired lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Refreshing network info cache for port f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:47 user nova-compute[75258]: INFO nova.compute.manager [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Terminating instance
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updated VIF entry in instance network info cache for port f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updating instance_info_cache with network_info: [{"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e1c26361-0186-4993-91a7-41b7f6766f8f req-77e5955b-6e04-4972-9b70-56237d6b2643 service nova] Releasing lock "refresh_cache-655df082-9b52-4bf6-8de5-e98f500e7454" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-ab548ffb-11ee-4e7c-9262-103a435f4601 req-c3f35b89-bb27-43ef-835f-4d4b7e87c79a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-unplugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab548ffb-11ee-4e7c-9262-103a435f4601 req-c3f35b89-bb27-43ef-835f-4d4b7e87c79a service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab548ffb-11ee-4e7c-9262-103a435f4601 req-c3f35b89-bb27-43ef-835f-4d4b7e87c79a service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ab548ffb-11ee-4e7c-9262-103a435f4601 req-c3f35b89-bb27-43ef-835f-4d4b7e87c79a service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-ab548ffb-11ee-4e7c-9262-103a435f4601 req-c3f35b89-bb27-43ef-835f-4d4b7e87c79a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-unplugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-ab548ffb-11ee-4e7c-9262-103a435f4601 req-c3f35b89-bb27-43ef-835f-4d4b7e87c79a service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-unplugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:47 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Instance destroyed successfully.
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lazy-loading 'resources' on Instance uuid 655df082-9b52-4bf6-8de5-e98f500e7454 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:51:59Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-605089217',display_name='tempest-TestStampPattern-server-605089217',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-605089217',id=31,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ5jpfwPDiaw/GQ227J0mNoSTCU3OtL4gaaSJfLmw6zipgxzksWqHCtyLbWdzoVaIm0VPX7LvotObrlI//TM1p6iFvBovNg/Llgf/G+LW/rsG9r3i/SqUfLRUo5ZiUWfzQ==',key_name='tempest-TestStampPattern-1020160408',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:52:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='abcfbbc31fe74017ba6be81499ff7592',ramdisk_id='',reservation_id='r-hi5v8ijj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-253582314',owner_user_name='tempest-TestStampPattern-253582314-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:55:00Z,user_data=None,user_id='24ce11c0aea848fcbe316b293ceecdf7',uuid=655df082-9b52-4bf6-8de5-e98f500e7454,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converting VIF {"id": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "address": "fa:16:3e:59:62:18", "network": {"id": "07c67386-bfc3-41f5-b7ef-e391846c2d5a", "bridge": "br-int", "label": "tempest-TestStampPattern-564344649-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "abcfbbc31fe74017ba6be81499ff7592", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0a6fcb7-42", "ovs_interfaceid": "f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:59:62:18,bridge_name='br-int',has_traffic_filtering=True,id=f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a6fcb7-42') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:58:47 user nova-compute[75258]: DEBUG os_vif [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:62:18,bridge_name='br-int',has_traffic_filtering=True,id=f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a6fcb7-42') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0a6fcb7-42, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25acd330-6f3b-4abe-97bb-361a548a8e26) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:58:48 user nova-compute[75258]: INFO os_vif [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:59:62:18,bridge_name='br-int',has_traffic_filtering=True,id=f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684,network=Network(07c67386-bfc3-41f5-b7ef-e391846c2d5a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0a6fcb7-42')
Nov 14 12:58:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Deleting instance files /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454_del
Nov 14 12:58:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Deletion of /opt/stack/data/nova/instances/655df082-9b52-4bf6-8de5-e98f500e7454_del complete
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: INFO nova.compute.manager [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 12:58:48 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Took 0.49 seconds to deallocate network for instance.
Nov 14 12:58:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:58:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.271s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:48 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Deleted allocations for instance 655df082-9b52-4bf6-8de5-e98f500e7454
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3d0c3c4f-b7f2-4cb4-9fb9-15e5a1dc777c tempest-TestStampPattern-253582314 tempest-TestStampPattern-253582314-project-member] Lock "655df082-9b52-4bf6-8de5-e98f500e7454" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-9c29012a-05d5-425e-9256-f6c818ed1586 req-9ba7bbfb-be71-452b-a1af-eee4d4a81cc8 service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-deleted-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:58:49 user nova-compute[75258]: WARNING nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received unexpected event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with vm_state deleted and task_state None.
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:58:49 user nova-compute[75258]: WARNING nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received unexpected event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with vm_state deleted and task_state None.
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:58:49 user nova-compute[75258]: WARNING nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received unexpected event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with vm_state deleted and task_state None.
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-unplugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-unplugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:58:49 user nova-compute[75258]: WARNING nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received unexpected event network-vif-unplugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with vm_state deleted and task_state None.
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Acquiring lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] Lock "655df082-9b52-4bf6-8de5-e98f500e7454-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:58:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] No waiting events found dispatching network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:58:49 user nova-compute[75258]: WARNING nova.compute.manager [req-d06f4d39-c7d6-4627-abf3-d2bac209e720 req-d8d69146-4939-4207-9cf7-d62579e00d6d service nova] [instance: 655df082-9b52-4bf6-8de5-e98f500e7454] Received unexpected event network-vif-plugged-f0a6fcb7-42c4-4c4a-be7b-0d48d8e34684 for instance with vm_state deleted and task_state None.
Nov 14 12:58:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:58:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:59:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-changed-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Refreshing instance network info cache due to event network-changed-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] Acquiring lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] Acquired lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG nova.network.neutron [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Refreshing network info cache for port 51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG nova.network.neutron [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updated VIF entry in instance network info cache for port 51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG nova.network.neutron [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updating instance_info_cache with network_info: [{"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:59:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1b012453-8d78-43d4-8b3b-391799b89d6e req-d9c490ad-f126-403c-a770-a7aa527fc2d2 service nova] Releasing lock "refresh_cache-3f9dc56b-c8db-4555-b4c3-9a3e2860309b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:59:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid 3f9dc56b-c8db-4555-b4c3-9a3e2860309b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:59:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.053s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:08 user nova-compute[75258]: INFO nova.compute.manager [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Attaching volume 07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 to /dev/vdb
Nov 14 12:59:08 user nova-compute[75258]: DEBUG os_brick.utils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7161c2e-4cbc-4470-9b8c-3c377c02f67b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a5323ce-d05d-478a-80af-4723bf24df28]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd33ff2-7700-487e-8c5e-225ea914d294]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6e81bd9-5cda-4ddd-9d7e-7f5893dcf617]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:59:08 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:59:08 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8d4617b-c946-4cf4-9158-62e80561869a]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG os_brick.utils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:59:08 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updating existing volume attachment record: 118b8fa4-6ea8-4fc3-a161-487825df7db4 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:59:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFfSIeil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:59:12 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:59:12 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:59:12 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f96b88-0f4a-466e-9624-47b85904ec14]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:59:12 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0696cc2-692c-4a46-8782-39668d495bd1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1] added
Nov 14 12:59:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56d82ae-bd14-41c8-8e96-14a4f5982e73]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b114ed06-8090-40e2-b632-45d6f7d1aacd]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFfSIeil {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rFfSIeil" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[260e15b6-8a67-4d2f-81e5-64d06fbef901]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rFfSIeil'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de81e473-0603-4414-91a0-5e85a5c85f35]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[608e64bb-a11c-4ab7-9576-5ffdd63fac82]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42b73ec-8dae-4db2-ba1f-500d4bb30898]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260]
Nov 14 12:59:12 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260] successful.
Nov 14 12:59:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0c166be-d5cd-458d-bd14-417e1386942d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1c1e314-4bf7-45c1-a7f9-4a36d0117957]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:12 user nova-compute[75258]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 (non-flash)
Nov 14 12:59:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:12 user nova-compute[75258]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 (non-flash)
Nov 14 12:59:12 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] HCTL ('33', '-', '-', 0) found on session 50 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1041fbea-fd2d-4c02-8a90-4852c293a5e7]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching for a device in session 50 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:59:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFfSIeil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:59:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:13 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:59:13 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23732336236656466', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:59:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23732336236656466', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:59:13 user nova-compute[75258]: DEBUG nova.objects.instance [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid 3f9dc56b-c8db-4555-b4c3-9a3e2860309b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:59:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:59:13 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:59:13 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:59:13 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:59:13 user nova-compute[75258]:   <serial>07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1</serial>
Nov 14 12:59:13 user nova-compute[75258]: </disk>
Nov 14 12:59:13 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No VIF found with MAC fa:16:3e:e3:88:ab, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-db53fb10-1806-4c6c-915f-4fe604a9cb26 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.094s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:14 user nova-compute[75258]: INFO nova.compute.manager [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Detaching volume 07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1
Nov 14 12:59:14 user nova-compute[75258]: INFO nova.virt.block_device [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Attempting to driver detach volume 07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 from mountpoint /dev/vdb
Nov 14 12:59:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Attempting to detach device vdb from instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:59:14 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:59:14 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:59:14 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:59:14 user nova-compute[75258]:   <serial>07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1</serial>
Nov 14 12:59:14 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:59:14 user nova-compute[75258]: </disk>
Nov 14 12:59:14 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:59:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully detached device vdb from instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b from the persistent domain config.
Nov 14 12:59:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:59:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:59:14 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:59:14 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:59:14 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:59:14 user nova-compute[75258]:   <serial>07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1</serial>
Nov 14 12:59:14 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:59:14 user nova-compute[75258]: </disk>
Nov 14 12:59:14 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:59:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:59:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:21 user nova-compute[75258]: INFO nova.compute.manager [None req-64679b01-504e-4bd5-8e7e-443d6187a720 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Get console output
Nov 14 12:59:21 user nova-compute[75258]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Nov 14 12:59:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid dc99e2bd-9c7e-4b04-a92a-8be01f6db176 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [{"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-dc99e2bd-9c7e-4b04-a92a-8be01f6db176" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:59:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 12:59:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:59:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-changed-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Refreshing instance network info cache due to event network-changed-25435b71-a918-4767-a996-4c92921df551. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] Acquiring lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] Acquired lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Refreshing network info cache for port 25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updated VIF entry in instance network info cache for port 25435b71-a918-4767-a996-4c92921df551. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updating instance_info_cache with network_info: [{"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ad4f8590-2eab-432e-9d27-a17247533414 req-26afb6d4-6c37-4565-bb5d-ee27f3dd2479 service nova] Releasing lock "refresh_cache-71591c79-60f9-4efd-a01d-9e824bb2255a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:31 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:59:31 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8450MB free_disk=25.10970687866211GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.objects.instance [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lazy-loading 'flavor' on Instance uuid 71591c79-60f9-4efd-a01d-9e824bb2255a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 2048}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 71591c79-60f9-4efd-a01d-9e824bb2255a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.068s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:31 user nova-compute[75258]: INFO nova.compute.manager [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Attaching volume d10eae75-c027-4afb-bac4-e7d686589d60 to /dev/vdb
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG os_brick.utils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.347s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeeb206e-6513-4f00-9ec8-5774ec7b9c12]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ba1ba12-5709-4c80-bffc-a43f69f6a1f2]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb96476-1da3-4b20-9ea5-af3e2e074c86]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f084c04-e293-4b46-a613-1a1e2674f089]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 12:59:31 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 12:59:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[174fcb36-90e1-4b79-9430-7380eaae5427]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG os_brick.utils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:59:31 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updating existing volume attachment record: 29b93ef7-2911-4419-8481-ef2b2186f380 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 12:59:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 12:59:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 12:59:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b is timed out.
Nov 14 12:59:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully detached device vdb from instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b from the live domain config.
Nov 14 12:59:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rFfSIeil', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:59:35 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dd17c62-0c6c-4e73-9ec9-a1350a6bf189]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:59:35 user nova-compute[75258]: No targets found.
Nov 14 12:59:35 user nova-compute[75258]: iSNS:
Nov 14 12:59:35 user nova-compute[75258]: No targets found.
Nov 14 12:59:35 user nova-compute[75258]: STATIC:
Nov 14 12:59:35 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1
Nov 14 12:59:35 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:59:35 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:59:35 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:59:35 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:59:35 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:59:35 user nova-compute[75258]: FIRMWARE:
Nov 14 12:59:35 user nova-compute[75258]: No targets found.
Nov 14 12:59:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:59:35 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:59:35 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ea4ede-35fa-472c-baa5-54a7876628a0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5468d58e-c2da-4523-8677-f34d877e2c7b]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:35 user nova-compute[75258]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 (non-flash)
Nov 14 12:59:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:35 user nova-compute[75258]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 (non-flash)
Nov 14 12:59:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c599090>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3afc8d87-eebc-4fd8-b3f3-01c08045654b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[10acf468-c87c-4fd6-a50f-dafb7582c2b1]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[951ac345-e935-422c-9b70-f9ed12b00cb8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[defe50cc-2366-4769-a5e4-089b6c3a1e2a]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14c8efb-4d2c-46ad-ae9c-819f3a0ab260]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d291f64a-e5f0-44ee-853d-6b1707e8b2b1]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260]
Nov 14 12:59:35 user nova-compute[75258]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1, portal: 172.16.0.220,3260] successful.
Nov 14 12:59:35 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:07b4c9f3-550c-4fe6-8c2b-ed8cec1221f1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f8873c-cff9-4097-8b3a-5aaaf257a166]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.295s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== disconnect_volume: return (297ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:59:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHYrUSID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:59:36 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:59:36 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:59:36 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[959aa50f-c099-461f-a7ce-a65348a25c1a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 12:59:36 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3bea47b-de57-4e27-bf38-09cbdab94328]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60] added
Nov 14 12:59:36 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c3a9b7d-eb92-4f7b-9385-bbc97f266aee]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[507302b0-b66e-47f4-8ac6-2aa3c7a0db48]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FHYrUSID {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FHYrUSID" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11eafbe-ef63-4604-934f-13304a6dbdd6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FHYrUSID'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fae6ba-a5ab-43b8-9a4c-55f03b266bc6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fd191f4-8666-42a6-bf23-aff9377c12a4]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:36 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:36 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d8dd076-f80c-4fa8-a8cc-ed1c7f71650c]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260]
Nov 14 12:59:36 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260] successful.
Nov 14 12:59:36 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid 3f9dc56b-c8db-4555-b4c3-9a3e2860309b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f006def0-6fed-4423-9690-ead56c7e84df]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7e14b836-601a-4a6b-b9c5-50a8c1fd0a6e tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.621s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1c1ad17-4f24-423d-9be9-9cc583bd1274]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:36 user nova-compute[75258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 (non-flash)
Nov 14 12:59:36 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:36 user nova-compute[75258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 (non-flash)
Nov 14 12:59:36 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.266s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[13d9b4c9-a901-446c-bd04-8fee05b21ff2]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:36 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHYrUSID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] <== connect_volume: return (1304ms) {'type': 'block', 'scsi_wwn': '26263353661363036', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263353661363036', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG nova.objects.instance [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lazy-loading 'flavor' on Instance uuid 71591c79-60f9-4efd-a01d-9e824bb2255a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 12:59:37 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:59:37 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:59:37 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:59:37 user nova-compute[75258]:   <serial>d10eae75-c027-4afb-bac4-e7d686589d60</serial>
Nov 14 12:59:37 user nova-compute[75258]: </disk>
Nov 14 12:59:37 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:59:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] No VIF found with MAC fa:16:3e:a8:8e:c1, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:59:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-74a637ee-1000-4de5-b50d-6180e733ad7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.381s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:39 user nova-compute[75258]: INFO nova.compute.manager [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Detaching volume d10eae75-c027-4afb-bac4-e7d686589d60
Nov 14 12:59:39 user nova-compute[75258]: INFO nova.virt.block_device [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Attempting to driver detach volume d10eae75-c027-4afb-bac4-e7d686589d60 from mountpoint /dev/vdb
Nov 14 12:59:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Attempting to detach device vdb from instance 71591c79-60f9-4efd-a01d-9e824bb2255a from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 12:59:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:59:39 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:59:39 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:59:39 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:59:39 user nova-compute[75258]:   <serial>d10eae75-c027-4afb-bac4-e7d686589d60</serial>
Nov 14 12:59:39 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:59:39 user nova-compute[75258]: </disk>
Nov 14 12:59:39 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:59:39 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Successfully detached device vdb from instance 71591c79-60f9-4efd-a01d-9e824bb2255a from the persistent domain config.
Nov 14 12:59:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 71591c79-60f9-4efd-a01d-9e824bb2255a from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 12:59:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 12:59:39 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 12:59:39 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 12:59:39 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 12:59:39 user nova-compute[75258]:   <serial>d10eae75-c027-4afb-bac4-e7d686589d60</serial>
Nov 14 12:59:39 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 12:59:39 user nova-compute[75258]: </disk>
Nov 14 12:59:39 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 12:59:39 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 71591c79-60f9-4efd-a01d-9e824bb2255a {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 12:59:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 12:59:45 user nova-compute[75258]: INFO nova.compute.claims [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Claim successful on node user
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.342s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 12:59:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.policy [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'efce5644ae184c458b7fe8e3ef4c66da', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '25cb1c380db14d12848d79ba9982681c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 12:59:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Creating image(s)
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "/opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "/opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "/opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk 1073741824" returned: 0 in 0.054s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.244s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Successfully created port: 4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Cannot resize image /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Ensure instance console log exists: /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Successfully updated port: 4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "refresh_cache-ed1e7666-fb0f-42a1-8034-cb2d1a845f03" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquired lock "refresh_cache-ed1e7666-fb0f-42a1-8034-cb2d1a845f03" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Received event network-changed-4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Refreshing instance network info cache due to event network-changed-4e10a25f-efe1-46ff-b066-973f400a5396. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] Acquiring lock "refresh_cache-ed1e7666-fb0f-42a1-8034-cb2d1a845f03" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Updating instance_info_cache with network_info: [{"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Releasing lock "refresh_cache-ed1e7666-fb0f-42a1-8034-cb2d1a845f03" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Instance network_info: |[{"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] Acquired lock "refresh_cache-ed1e7666-fb0f-42a1-8034-cb2d1a845f03" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Refreshing network info cache for port 4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Start _get_guest_xml network_info=[{"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 12:59:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:59:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1406777164',display_name='tempest-ServersNegativeTestJSON-server-1406777164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1406777164',id=38,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25cb1c380db14d12848d79ba9982681c',ramdisk_id='',reservation_id='r-dw9igffo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-8951680',owner_user_name='tempest-ServersNegativeTestJSON-8951680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:59:46Z,user_data=None,user_id='efce5644ae184c458b7fe8e3ef4c66da',uuid=ed1e7666-fb0f-42a1-8034-cb2d1a845f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converting VIF {"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:84:bf,bridge_name='br-int',has_traffic_filtering=True,id=4e10a25f-efe1-46ff-b066-973f400a5396,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e10a25f-ef') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lazy-loading 'pci_devices' on Instance uuid ed1e7666-fb0f-42a1-8034-cb2d1a845f03 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] End _get_guest_xml xml=<domain type="kvm">
Nov 14 12:59:47 user nova-compute[75258]:   <uuid>ed1e7666-fb0f-42a1-8034-cb2d1a845f03</uuid>
Nov 14 12:59:47 user nova-compute[75258]:   <name>instance-00000026</name>
Nov 14 12:59:47 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 12:59:47 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 12:59:47 user nova-compute[75258]:   <metadata>
Nov 14 12:59:47 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 12:59:47 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 12:59:47 user nova-compute[75258]:       <nova:name>tempest-ServersNegativeTestJSON-server-1406777164</nova:name>
Nov 14 12:59:47 user nova-compute[75258]:       <nova:creationTime>2023-11-14 12:59:47</nova:creationTime>
Nov 14 12:59:47 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 12:59:47 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 12:59:47 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 12:59:47 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 12:59:47 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 12:59:47 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 12:59:47 user nova-compute[75258]:       </nova:flavor>
Nov 14 12:59:47 user nova-compute[75258]:       <nova:owner>
Nov 14 12:59:47 user nova-compute[75258]:         <nova:user uuid="efce5644ae184c458b7fe8e3ef4c66da">tempest-ServersNegativeTestJSON-8951680-project-member</nova:user>
Nov 14 12:59:47 user nova-compute[75258]:         <nova:project uuid="25cb1c380db14d12848d79ba9982681c">tempest-ServersNegativeTestJSON-8951680</nova:project>
Nov 14 12:59:47 user nova-compute[75258]:       </nova:owner>
Nov 14 12:59:47 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 12:59:47 user nova-compute[75258]:       <nova:ports>
Nov 14 12:59:47 user nova-compute[75258]:         <nova:port uuid="4e10a25f-efe1-46ff-b066-973f400a5396">
Nov 14 12:59:47 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Nov 14 12:59:47 user nova-compute[75258]:         </nova:port>
Nov 14 12:59:47 user nova-compute[75258]:       </nova:ports>
Nov 14 12:59:47 user nova-compute[75258]:     </nova:instance>
Nov 14 12:59:47 user nova-compute[75258]:   </metadata>
Nov 14 12:59:47 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 12:59:47 user nova-compute[75258]:     <system>
Nov 14 12:59:47 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 12:59:47 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 12:59:47 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 12:59:47 user nova-compute[75258]:       <entry name="serial">ed1e7666-fb0f-42a1-8034-cb2d1a845f03</entry>
Nov 14 12:59:47 user nova-compute[75258]:       <entry name="uuid">ed1e7666-fb0f-42a1-8034-cb2d1a845f03</entry>
Nov 14 12:59:47 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 12:59:47 user nova-compute[75258]:     </system>
Nov 14 12:59:47 user nova-compute[75258]:   </sysinfo>
Nov 14 12:59:47 user nova-compute[75258]:   <os>
Nov 14 12:59:47 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 12:59:47 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 12:59:47 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 12:59:47 user nova-compute[75258]:   </os>
Nov 14 12:59:47 user nova-compute[75258]:   <features>
Nov 14 12:59:47 user nova-compute[75258]:     <acpi/>
Nov 14 12:59:47 user nova-compute[75258]:     <apic/>
Nov 14 12:59:47 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 12:59:47 user nova-compute[75258]:   </features>
Nov 14 12:59:47 user nova-compute[75258]:   <clock offset="utc">
Nov 14 12:59:47 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 12:59:47 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 12:59:47 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 12:59:47 user nova-compute[75258]:   </clock>
Nov 14 12:59:47 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 12:59:47 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 12:59:47 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 12:59:47 user nova-compute[75258]:   </cpu>
Nov 14 12:59:47 user nova-compute[75258]:   <devices>
Nov 14 12:59:47 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 12:59:47 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 12:59:47 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk"/>
Nov 14 12:59:47 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 12:59:47 user nova-compute[75258]:     </disk>
Nov 14 12:59:47 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 12:59:47 user nova-compute[75258]:       <mac address="fa:16:3e:0f:84:bf"/>
Nov 14 12:59:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:59:47 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 12:59:47 user nova-compute[75258]:       <target dev="tap4e10a25f-ef"/>
Nov 14 12:59:47 user nova-compute[75258]:     </interface>
Nov 14 12:59:47 user nova-compute[75258]:     <serial type="pty">
Nov 14 12:59:47 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/console.log" append="off"/>
Nov 14 12:59:47 user nova-compute[75258]:     </serial>
Nov 14 12:59:47 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 12:59:47 user nova-compute[75258]:     <video>
Nov 14 12:59:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 12:59:47 user nova-compute[75258]:     </video>
Nov 14 12:59:47 user nova-compute[75258]:     <rng model="virtio">
Nov 14 12:59:47 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 12:59:47 user nova-compute[75258]:     </rng>
Nov 14 12:59:47 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 12:59:47 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 12:59:47 user nova-compute[75258]:       <stats period="10"/>
Nov 14 12:59:47 user nova-compute[75258]:     </memballoon>
Nov 14 12:59:47 user nova-compute[75258]:   </devices>
Nov 14 12:59:47 user nova-compute[75258]: </domain>
Nov 14 12:59:47 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1406777164',display_name='tempest-ServersNegativeTestJSON-server-1406777164',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1406777164',id=38,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='25cb1c380db14d12848d79ba9982681c',ramdisk_id='',reservation_id='r-dw9igffo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-8951680',owner_user_name='tempest-ServersNegativeTestJSON-8951680-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T12:59:46Z,user_data=None,user_id='efce5644ae184c458b7fe8e3ef4c66da',uuid=ed1e7666-fb0f-42a1-8034-cb2d1a845f03,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converting VIF {"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:84:bf,bridge_name='br-int',has_traffic_filtering=True,id=4e10a25f-efe1-46ff-b066-973f400a5396,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e10a25f-ef') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG os_vif [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:84:bf,bridge_name='br-int',has_traffic_filtering=True,id=4e10a25f-efe1-46ff-b066-973f400a5396,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e10a25f-ef') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29e16778-9a5f-5588-82a1-61c5f961930e', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4e10a25f-ef, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4e10a25f-ef, col_values=(('qos', UUID('435000f3-cda6-465c-a138-5d12cbc36420')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4e10a25f-ef, col_values=(('external_ids', {'iface-id': '4e10a25f-efe1-46ff-b066-973f400a5396', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:84:bf', 'vm-uuid': 'ed1e7666-fb0f-42a1-8034-cb2d1a845f03'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:47 user nova-compute[75258]: INFO os_vif [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:84:bf,bridge_name='br-int',has_traffic_filtering=True,id=4e10a25f-efe1-46ff-b066-973f400a5396,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e10a25f-ef')
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] No VIF found with MAC fa:16:3e:0f:84:bf, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Updated VIF entry in instance network info cache for port 4e10a25f-efe1-46ff-b066-973f400a5396. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Updating instance_info_cache with network_info: [{"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 12:59:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-43116331-c6bc-43ec-8fbb-e1639de0897b req-625096f0-0ebd-4467-a162-b07791bf8af7 service nova] Releasing lock "refresh_cache-ed1e7666-fb0f-42a1-8034-cb2d1a845f03" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 12:59:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-6fcfd752-8217-4e0d-8804-44c7a72c45ca req-18ede170-4201-48ae-aae1-3f467286a30c service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Received event network-vif-plugged-4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:59:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6fcfd752-8217-4e0d-8804-44c7a72c45ca req-18ede170-4201-48ae-aae1-3f467286a30c service nova] Acquiring lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6fcfd752-8217-4e0d-8804-44c7a72c45ca req-18ede170-4201-48ae-aae1-3f467286a30c service nova] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6fcfd752-8217-4e0d-8804-44c7a72c45ca req-18ede170-4201-48ae-aae1-3f467286a30c service nova] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-6fcfd752-8217-4e0d-8804-44c7a72c45ca req-18ede170-4201-48ae-aae1-3f467286a30c service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] No waiting events found dispatching network-vif-plugged-4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:59:49 user nova-compute[75258]: WARNING nova.compute.manager [req-6fcfd752-8217-4e0d-8804-44c7a72c45ca req-18ede170-4201-48ae-aae1-3f467286a30c service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Received unexpected event network-vif-plugged-4e10a25f-efe1-46ff-b066-973f400a5396 for instance with vm_state building and task_state spawning.
Nov 14 12:59:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 12:59:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 12:59:50 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Instance spawned successfully.
Nov 14 12:59:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-b7bf3a9d-5165-4068-8378-5a424b358f9d req-12d4a4c4-ffaa-409d-98e7-e0bae701ffdf service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Received event network-vif-plugged-4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b7bf3a9d-5165-4068-8378-5a424b358f9d req-12d4a4c4-ffaa-409d-98e7-e0bae701ffdf service nova] Acquiring lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b7bf3a9d-5165-4068-8378-5a424b358f9d req-12d4a4c4-ffaa-409d-98e7-e0bae701ffdf service nova] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b7bf3a9d-5165-4068-8378-5a424b358f9d req-12d4a4c4-ffaa-409d-98e7-e0bae701ffdf service nova] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-b7bf3a9d-5165-4068-8378-5a424b358f9d req-12d4a4c4-ffaa-409d-98e7-e0bae701ffdf service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] No waiting events found dispatching network-vif-plugged-4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 12:59:51 user nova-compute[75258]: WARNING nova.compute.manager [req-b7bf3a9d-5165-4068-8378-5a424b358f9d req-12d4a4c4-ffaa-409d-98e7-e0bae701ffdf service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Received unexpected event network-vif-plugged-4e10a25f-efe1-46ff-b066-973f400a5396 for instance with vm_state building and task_state spawning.
Nov 14 12:59:51 user nova-compute[75258]: INFO nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Took 5.26 seconds to spawn the instance on the hypervisor.
Nov 14 12:59:51 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 12:59:51 user nova-compute[75258]: INFO nova.compute.manager [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Took 6.04 seconds to build instance.
Nov 14 12:59:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee99b9b9-8e60-4fe6-89da-8cc34f2d7c11 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.129s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 12:59:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 12:59:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 12:59:59 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 71591c79-60f9-4efd-a01d-9e824bb2255a is timed out.
Nov 14 12:59:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Successfully detached device vdb from instance 71591c79-60f9-4efd-a01d-9e824bb2255a from the live domain config.
Nov 14 12:59:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FHYrUSID', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 12:59:59 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f17e103-c20a-41de-83c6-8398c8169448]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 12:59:59 user nova-compute[75258]: No targets found.
Nov 14 12:59:59 user nova-compute[75258]: iSNS:
Nov 14 12:59:59 user nova-compute[75258]: No targets found.
Nov 14 12:59:59 user nova-compute[75258]: STATIC:
Nov 14 12:59:59 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 12:59:59 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:59:59 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:59:59 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60
Nov 14 12:59:59 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 12:59:59 user nova-compute[75258]:                 Iface Name: default
Nov 14 12:59:59 user nova-compute[75258]: FIRMWARE:
Nov 14 12:59:59 user nova-compute[75258]: No targets found.
Nov 14 12:59:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 12:59:59 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 12:59:59 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9c2c70-9aea-4552-a081-d364fd3334dd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1daf95a-ab7b-46d4-ba38-bf373a41b7ff]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\ntcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:59 user nova-compute[75258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 (non-flash)
Nov 14 12:59:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 12:59:59 user nova-compute[75258]: tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 (non-flash)
Nov 14 12:59:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4ac319000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfffdf0-ca78-4c6f-85be-1333cb5bea0b]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bef4c18f-12d3-45aa-af55-d140b7c7038b]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[963e6e61-b07b-4621-b14a-daf213c16724]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.047s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6063e76-7ff3-45cb-8301-9ace450ce36a]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa71e70a-0a15-4d96-9e24-bade02ea6443]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --logout" returned: 0 in 0.093s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87260e5-e593-4a03-9d1a-1aae781148e3]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260]
Nov 14 12:59:59 user nova-compute[75258]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60, portal: 172.16.0.220,3260] successful.
Nov 14 12:59:59 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d10eae75-c027-4afb-bac4-e7d686589d60 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c9e58-c872-49e4-ade3-02353102b528]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.349s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] <== disconnect_volume: return (350ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 12:59:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:00:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lazy-loading 'flavor' on Instance uuid 71591c79-60f9-4efd-a01d-9e824bb2255a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:00:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d3b6d1ff-031c-4669-a9fa-b9c5373145d4 tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.750s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:00:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:00:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:00:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:05 user nova-compute[75258]: INFO nova.compute.manager [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Terminating instance
Nov 14 13:00:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-294df6ea-f6bc-4a99-afdf-932d472cfae2 req-83c14cc8-6983-44e4-a04b-cc2bd97af03d service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-vif-unplugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-294df6ea-f6bc-4a99-afdf-932d472cfae2 req-83c14cc8-6983-44e4-a04b-cc2bd97af03d service nova] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-294df6ea-f6bc-4a99-afdf-932d472cfae2 req-83c14cc8-6983-44e4-a04b-cc2bd97af03d service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-294df6ea-f6bc-4a99-afdf-932d472cfae2 req-83c14cc8-6983-44e4-a04b-cc2bd97af03d service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-294df6ea-f6bc-4a99-afdf-932d472cfae2 req-83c14cc8-6983-44e4-a04b-cc2bd97af03d service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] No waiting events found dispatching network-vif-unplugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:00:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-294df6ea-f6bc-4a99-afdf-932d472cfae2 req-83c14cc8-6983-44e4-a04b-cc2bd97af03d service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-vif-unplugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:00:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Instance destroyed successfully.
Nov 14 13:00:06 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'resources' on Instance uuid 3f9dc56b-c8db-4555-b4c3-9a3e2860309b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:14Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-2014533456',display_name='tempest-AttachVolumeNegativeTest-server-2014533456',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-2014533456',id=35,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUo/KZKQ+/hpwzl8DX4nIg7lQ6d2LJCyGDLQS+tzigcrFA8sLM8ewJKkkNnWRGNPy85oCaIemEag1uAtjMXjUAs2hXLQIAM5LkqdyGBVr9cbQb033YcaBUHnSs+aG8A2w==',key_name='tempest-keypair-1916589535',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:57:21Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-0oetm10m',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:57:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=3f9dc56b-c8db-4555-b4c3-9a3e2860309b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "address": "fa:16:3e:e3:88:ab", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.146", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51cf7a33-57", "ovs_interfaceid": "51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e3:88:ab,bridge_name='br-int',has_traffic_filtering=True,id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cf7a33-57') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG os_vif [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:88:ab,bridge_name='br-int',has_traffic_filtering=True,id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cf7a33-57') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51cf7a33-57, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6723b3f4-9bbc-4fb4-a1cf-668930bbeb86) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:06 user nova-compute[75258]: INFO os_vif [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e3:88:ab,bridge_name='br-int',has_traffic_filtering=True,id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51cf7a33-57')
Nov 14 13:00:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Deleting instance files /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b_del
Nov 14 13:00:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Deletion of /opt/stack/data/nova/instances/3f9dc56b-c8db-4555-b4c3-9a3e2860309b_del complete
Nov 14 13:00:06 user nova-compute[75258]: INFO nova.compute.manager [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Took 1.03 seconds to destroy the instance on the hypervisor.
Nov 14 13:00:06 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:00:06 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:00:07 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Took 0.91 seconds to deallocate network for instance.
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-8acb7666-1198-44bc-b5b7-044bc8d4eeaa req-2dedc9b3-ac7c-43b9-8fbc-7fb51b0d50ba service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-vif-deleted-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:07 user nova-compute[75258]: INFO nova.compute.manager [req-8acb7666-1198-44bc-b5b7-044bc8d4eeaa req-2dedc9b3-ac7c-43b9-8fbc-7fb51b0d50ba service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Neutron deleted interface 51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d; detaching it from the instance and deleting it from the info cache
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-8acb7666-1198-44bc-b5b7-044bc8d4eeaa req-2dedc9b3-ac7c-43b9-8fbc-7fb51b0d50ba service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-8acb7666-1198-44bc-b5b7-044bc8d4eeaa req-2dedc9b3-ac7c-43b9-8fbc-7fb51b0d50ba service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Detach interface failed, port_id=51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d, reason: Instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.224s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:07 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Deleted allocations for instance 3f9dc56b-c8db-4555-b4c3-9a3e2860309b
Nov 14 13:00:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5f4f09ee-4d80-4131-9aa7-d53b217919a2 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.350s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-bb3d51c9-1f35-48e7-8f73-4a7382e6fd99 req-6f3d457b-f657-49cb-b683-1b8b1095833b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received event network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bb3d51c9-1f35-48e7-8f73-4a7382e6fd99 req-6f3d457b-f657-49cb-b683-1b8b1095833b service nova] Acquiring lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bb3d51c9-1f35-48e7-8f73-4a7382e6fd99 req-6f3d457b-f657-49cb-b683-1b8b1095833b service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bb3d51c9-1f35-48e7-8f73-4a7382e6fd99 req-6f3d457b-f657-49cb-b683-1b8b1095833b service nova] Lock "3f9dc56b-c8db-4555-b4c3-9a3e2860309b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-bb3d51c9-1f35-48e7-8f73-4a7382e6fd99 req-6f3d457b-f657-49cb-b683-1b8b1095833b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] No waiting events found dispatching network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:00:07 user nova-compute[75258]: WARNING nova.compute.manager [req-bb3d51c9-1f35-48e7-8f73-4a7382e6fd99 req-6f3d457b-f657-49cb-b683-1b8b1095833b service nova] [instance: 3f9dc56b-c8db-4555-b4c3-9a3e2860309b] Received unexpected event network-vif-plugged-51cf7a33-57ef-4fcc-b8c1-aa9abbb0e09d for instance with vm_state deleted and task_state None.
Nov 14 13:00:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:21 user nova-compute[75258]: INFO nova.compute.manager [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Terminating instance
Nov 14 13:00:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [{"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:00:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-d935c4d0-e241-4be1-b07c-f22a761d1e67 req-35ba59f4-4f4c-4411-ab6f-6de3900e2f93 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d935c4d0-e241-4be1-b07c-f22a761d1e67 req-35ba59f4-4f4c-4411-ab6f-6de3900e2f93 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d935c4d0-e241-4be1-b07c-f22a761d1e67 req-35ba59f4-4f4c-4411-ab6f-6de3900e2f93 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d935c4d0-e241-4be1-b07c-f22a761d1e67 req-35ba59f4-4f4c-4411-ab6f-6de3900e2f93 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-d935c4d0-e241-4be1-b07c-f22a761d1e67 req-35ba59f4-4f4c-4411-ab6f-6de3900e2f93 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-d935c4d0-e241-4be1-b07c-f22a761d1e67 req-35ba59f4-4f4c-4411-ab6f-6de3900e2f93 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-unplugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Instance destroyed successfully.
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'resources' on Instance uuid a7b11d71-ee0a-47e0-a1e2-2206f0be1b46 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:53:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-249838839',display_name='tempest-ServerActionsTestOtherA-server-249838839',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-249838839',id=33,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:55:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-cgmyb0n6',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:57:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=a7b11d71-ee0a-47e0-a1e2-2206f0be1b46,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "1db3ef49-8294-4f19-95a7-6499221f589a", "address": "fa:16:3e:cd:67:df", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.180", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap1db3ef49-82", "ovs_interfaceid": "1db3ef49-8294-4f19-95a7-6499221f589a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_vif [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap1db3ef49-82, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f372e708-26ee-45ca-bae0-06e8accccaae) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:22 user nova-compute[75258]: INFO os_vif [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cd:67:df,bridge_name='br-int',has_traffic_filtering=True,id=1db3ef49-8294-4f19-95a7-6499221f589a,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap1db3ef49-82')
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'GzDgjuYO', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:00:22 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbc6f34-9c03-48f7-88c0-82569e6048a9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:00:22 user nova-compute[75258]: No targets found.
Nov 14 13:00:22 user nova-compute[75258]: iSNS:
Nov 14 13:00:22 user nova-compute[75258]: No targets found.
Nov 14 13:00:22 user nova-compute[75258]: STATIC:
Nov 14 13:00:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d
Nov 14 13:00:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:00:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:00:22 user nova-compute[75258]: FIRMWARE:
Nov 14 13:00:22 user nova-compute[75258]: No targets found.
Nov 14 13:00:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:00:22 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:00:22 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2681198c-f2a2-4382-831a-de1928e3d4ac]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[245c7e85-fc8a-4008-84a8-56392da7d75d]: (4, ('tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 13:00:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsi session list stdout=tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d (non-flash)
Nov 14 13:00:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c765990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d'): ({'sdc'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Removing single pathed devices sdc {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f501663-5c63-4480-85fa-db086c38cd21]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b9c1051-899a-4601-a8ae-555c1bc59416]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Flushing IO for device /dev/sdc {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea18710c-0430-4bb2-9321-7578286086e3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.039s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e58732d7-65d1-43d6-80b7-390f0a8f15c1]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26464636331353636', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_23fcb303', '/dev/disk/by-id/scsi-1SCST_BIO23fcb303-ddcc1566603f5326') {{(pid=86014) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4f9ccc3-966d-43d5-a309-3eafc29cec99]: (4, None) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d01c31a-d817-4d27-84f2-cfc8051c427d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --logout" returned: 0 in 0.089s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fa1baba-148d-4d94-8878-50af5f261d63]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260]
Nov 14 13:00:22 user nova-compute[75258]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d, portal: 172.16.0.220,3260] successful.
Nov 14 13:00:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:10da2cc0-95ea-4f88-83ef-2db5d629e03d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[413d0dec-b726-4d29-b7a1-09f7d166333e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.345s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] <== disconnect_volume: return (347ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:00:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:00:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Deleting instance files /opt/stack/data/nova/instances/a7b11d71-ee0a-47e0-a1e2-2206f0be1b46_del
Nov 14 13:00:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Deletion of /opt/stack/data/nova/instances/a7b11d71-ee0a-47e0-a1e2-2206f0be1b46_del complete
Nov 14 13:00:23 user nova-compute[75258]: INFO nova.compute.manager [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 13:00:23 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:00:23 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:00:23 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:00:23 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:00:23 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Took 0.84 seconds to deallocate network for instance.
Nov 14 13:00:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-7485707a-315e-4caa-bff1-9413f1b0a053 req-1c617d00-8f34-4372-8ddc-e999cf1e44d4 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7485707a-315e-4caa-bff1-9413f1b0a053 req-1c617d00-8f34-4372-8ddc-e999cf1e44d4 service nova] Acquiring lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7485707a-315e-4caa-bff1-9413f1b0a053 req-1c617d00-8f34-4372-8ddc-e999cf1e44d4 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7485707a-315e-4caa-bff1-9413f1b0a053 req-1c617d00-8f34-4372-8ddc-e999cf1e44d4 service nova] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-7485707a-315e-4caa-bff1-9413f1b0a053 req-1c617d00-8f34-4372-8ddc-e999cf1e44d4 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] No waiting events found dispatching network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:00:24 user nova-compute[75258]: WARNING nova.compute.manager [req-7485707a-315e-4caa-bff1-9413f1b0a053 req-1c617d00-8f34-4372-8ddc-e999cf1e44d4 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received unexpected event network-vif-plugged-1db3ef49-8294-4f19-95a7-6499221f589a for instance with vm_state active and task_state deleting.
Nov 14 13:00:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-7485707a-315e-4caa-bff1-9413f1b0a053 req-1c617d00-8f34-4372-8ddc-e999cf1e44d4 service nova] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Received event network-vif-deleted-1db3ef49-8294-4f19-95a7-6499221f589a {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:24 user nova-compute[75258]: INFO nova.compute.manager [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 13:00:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: a7b11d71-ee0a-47e0-a1e2-2206f0be1b46] Deleting volume: 10da2cc0-95ea-4f88-83ef-2db5d629e03d {{(pid=75258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:00:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.210s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:24 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Deleted allocations for instance a7b11d71-ee0a-47e0-a1e2-2206f0be1b46
Nov 14 13:00:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6dfcf0a8-84a5-4177-8501-5537451eef6b tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "a7b11d71-ee0a-47e0-a1e2-2206f0be1b46" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.234s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:31 user nova-compute[75258]: INFO nova.compute.manager [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Terminating instance
Nov 14 13:00:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-e7040a21-43fa-4f9d-aaad-94b7f58809c4 req-d79f2319-6859-4a6c-8d91-84c3dde2ce52 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-vif-unplugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e7040a21-43fa-4f9d-aaad-94b7f58809c4 req-d79f2319-6859-4a6c-8d91-84c3dde2ce52 service nova] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e7040a21-43fa-4f9d-aaad-94b7f58809c4 req-d79f2319-6859-4a6c-8d91-84c3dde2ce52 service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e7040a21-43fa-4f9d-aaad-94b7f58809c4 req-d79f2319-6859-4a6c-8d91-84c3dde2ce52 service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-e7040a21-43fa-4f9d-aaad-94b7f58809c4 req-d79f2319-6859-4a6c-8d91-84c3dde2ce52 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] No waiting events found dispatching network-vif-unplugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:00:31 user nova-compute[75258]: DEBUG nova.compute.manager [req-e7040a21-43fa-4f9d-aaad-94b7f58809c4 req-d79f2319-6859-4a6c-8d91-84c3dde2ce52 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-vif-unplugged-25435b71-a918-4767-a996-4c92921df551 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Instance destroyed successfully.
Nov 14 13:00:32 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lazy-loading 'resources' on Instance uuid 71591c79-60f9-4efd-a01d-9e824bb2255a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-930041350',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-930041350',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-9300413',id=36,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKkXUSIjMMgLeAfPOyU3t+L+9p7z5VIWrh+wjbk8o37jUYZNtW1SCM+fVzxWcrmst6suz5ebS4mf06jrxSodvV3BDNWroWMrGcn9QiQH6wmwR3pmwzGwsWDWVU0AtNfFfA==',key_name='tempest-keypair-2010265157',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:57:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='93e782e5dc7c4b778282830cd303b76a',ramdisk_id='',reservation_id='r-qp9emtbm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-600757002',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:57:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ce04af2bfa934429abfe2c01e783ef6f',uuid=71591c79-60f9-4efd-a01d-9e824bb2255a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Converting VIF {"id": "25435b71-a918-4767-a996-4c92921df551", "address": "fa:16:3e:a8:8e:c1", "network": {"id": "2bb2ada5-d151-40e2-b291-0ed7b8da10ba", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-1984080447-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.226", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "93e782e5dc7c4b778282830cd303b76a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap25435b71-a9", "ovs_interfaceid": "25435b71-a918-4767-a996-4c92921df551", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:a8:8e:c1,bridge_name='br-int',has_traffic_filtering=True,id=25435b71-a918-4767-a996-4c92921df551,network=Network(2bb2ada5-d151-40e2-b291-0ed7b8da10ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25435b71-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG os_vif [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:8e:c1,bridge_name='br-int',has_traffic_filtering=True,id=25435b71-a918-4767-a996-4c92921df551,network=Network(2bb2ada5-d151-40e2-b291-0ed7b8da10ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25435b71-a9') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap25435b71-a9, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7e4a91e0-8a6b-41df-b235-0e34aa96d9ab) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:32 user nova-compute[75258]: INFO os_vif [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:a8:8e:c1,bridge_name='br-int',has_traffic_filtering=True,id=25435b71-a918-4767-a996-4c92921df551,network=Network(2bb2ada5-d151-40e2-b291-0ed7b8da10ba),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap25435b71-a9')
Nov 14 13:00:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Deleting instance files /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a_del
Nov 14 13:00:32 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Deletion of /opt/stack/data/nova/instances/71591c79-60f9-4efd-a01d-9e824bb2255a_del complete
Nov 14 13:00:32 user nova-compute[75258]: INFO nova.compute.manager [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Took 0.89 seconds to destroy the instance on the hypervisor.
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:33 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:00:33 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8607MB free_disk=25.09839630126953GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:00:33 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Took 1.00 seconds to deallocate network for instance.
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-15e84ae8-2cd1-4227-8993-02c13f109845 req-190b172a-f23d-4f19-9117-74dabaa7d1c3 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-vif-deleted-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:33 user nova-compute[75258]: INFO nova.compute.manager [req-15e84ae8-2cd1-4227-8993-02c13f109845 req-190b172a-f23d-4f19-9117-74dabaa7d1c3 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Neutron deleted interface 25435b71-a918-4767-a996-4c92921df551; detaching it from the instance and deleting it from the info cache
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.network.neutron [req-15e84ae8-2cd1-4227-8993-02c13f109845 req-190b172a-f23d-4f19-9117-74dabaa7d1c3 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 71591c79-60f9-4efd-a01d-9e824bb2255a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ed1e7666-fb0f-42a1-8034-cb2d1a845f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-15e84ae8-2cd1-4227-8993-02c13f109845 req-190b172a-f23d-4f19-9117-74dabaa7d1c3 service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Detach interface failed, port_id=25435b71-a918-4767-a996-4c92921df551, reason: Instance 71591c79-60f9-4efd-a01d-9e824bb2255a could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.315s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.163s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.165s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:33 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Deleted allocations for instance 71591c79-60f9-4efd-a01d-9e824bb2255a
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6ad9f41b-899a-4243-8a86-d0cd17594f7d tempest-TestServerVolumeAttachScenarioOldVersion-600757002 tempest-TestServerVolumeAttachScenarioOldVersion-600757002-project-member] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.399s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-8d2f2176-b8e0-4677-84f0-0d48b419b3cc req-41f7afb2-9136-4c90-9892-5d983f05558f service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received event network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8d2f2176-b8e0-4677-84f0-0d48b419b3cc req-41f7afb2-9136-4c90-9892-5d983f05558f service nova] Acquiring lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8d2f2176-b8e0-4677-84f0-0d48b419b3cc req-41f7afb2-9136-4c90-9892-5d983f05558f service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8d2f2176-b8e0-4677-84f0-0d48b419b3cc req-41f7afb2-9136-4c90-9892-5d983f05558f service nova] Lock "71591c79-60f9-4efd-a01d-9e824bb2255a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-8d2f2176-b8e0-4677-84f0-0d48b419b3cc req-41f7afb2-9136-4c90-9892-5d983f05558f service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] No waiting events found dispatching network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:00:33 user nova-compute[75258]: WARNING nova.compute.manager [req-8d2f2176-b8e0-4677-84f0-0d48b419b3cc req-41f7afb2-9136-4c90-9892-5d983f05558f service nova] [instance: 71591c79-60f9-4efd-a01d-9e824bb2255a] Received unexpected event network-vif-plugged-25435b71-a918-4767-a996-4c92921df551 for instance with vm_state deleted and task_state None.
Nov 14 13:00:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:00:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:00:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:00:58 user nova-compute[75258]: INFO nova.compute.claims [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Claim successful on node user
Nov 14 13:00:58 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.281s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:00:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:00:59 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Creating image(s)
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "/opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "/opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.policy [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0d957bc3f2cf4beb931c5796ce2a4c42', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c080a084f2b8483894a1904531d152ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk 1073741824" returned: 0 in 0.049s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.199s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Successfully created port: ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Cannot resize image /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Ensure instance console log exists: /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:00:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Successfully updated port: ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquired lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-changed-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Refreshing instance network info cache due to event network-changed-ef42907d-c912-4956-afed-14d8c9a6fdc3. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] Acquiring lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:01:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updating instance_info_cache with network_info: [{"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Releasing lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Instance network_info: |[{"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] Acquired lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Refreshing network info cache for port ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Start _get_guest_xml network_info=[{"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:01:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:01:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-450070849',display_name='tempest-AttachVolumeNegativeTest-server-450070849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-450070849',id=39,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9hsjklcK5NwB/2zHV4cK/8yeRXldhHXokx0fJwISdYStx8SXG5St/+tP86PtxlyW8Xmoh6XymHASsXnF80XkYQ2jrN6TctmIEYUGEL3c13L9t54X21+SebsZOBtO2oEQ==',key_name='tempest-keypair-1428488612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-8isqjlk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=ce45b26c-7df5-415f-9fbb-151f3684b6a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:a1,bridge_name='br-int',has_traffic_filtering=True,id=ef42907d-c912-4956-afed-14d8c9a6fdc3,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef42907d-c9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'pci_devices' on Instance uuid ce45b26c-7df5-415f-9fbb-151f3684b6a9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:01:01 user nova-compute[75258]:   <uuid>ce45b26c-7df5-415f-9fbb-151f3684b6a9</uuid>
Nov 14 13:01:01 user nova-compute[75258]:   <name>instance-00000027</name>
Nov 14 13:01:01 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:01:01 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:01:01 user nova-compute[75258]:   <metadata>
Nov 14 13:01:01 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:01:01 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:01:01 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeNegativeTest-server-450070849</nova:name>
Nov 14 13:01:01 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:01:01</nova:creationTime>
Nov 14 13:01:01 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:01:01 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:01:01 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:01:01 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:01:01 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:01:01 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:01:01 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:01:01 user nova-compute[75258]:       <nova:owner>
Nov 14 13:01:01 user nova-compute[75258]:         <nova:user uuid="0d957bc3f2cf4beb931c5796ce2a4c42">tempest-AttachVolumeNegativeTest-694932868-project-member</nova:user>
Nov 14 13:01:01 user nova-compute[75258]:         <nova:project uuid="c080a084f2b8483894a1904531d152ca">tempest-AttachVolumeNegativeTest-694932868</nova:project>
Nov 14 13:01:01 user nova-compute[75258]:       </nova:owner>
Nov 14 13:01:01 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:01:01 user nova-compute[75258]:       <nova:ports>
Nov 14 13:01:01 user nova-compute[75258]:         <nova:port uuid="ef42907d-c912-4956-afed-14d8c9a6fdc3">
Nov 14 13:01:01 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Nov 14 13:01:01 user nova-compute[75258]:         </nova:port>
Nov 14 13:01:01 user nova-compute[75258]:       </nova:ports>
Nov 14 13:01:01 user nova-compute[75258]:     </nova:instance>
Nov 14 13:01:01 user nova-compute[75258]:   </metadata>
Nov 14 13:01:01 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:01:01 user nova-compute[75258]:     <system>
Nov 14 13:01:01 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:01:01 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:01:01 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:01:01 user nova-compute[75258]:       <entry name="serial">ce45b26c-7df5-415f-9fbb-151f3684b6a9</entry>
Nov 14 13:01:01 user nova-compute[75258]:       <entry name="uuid">ce45b26c-7df5-415f-9fbb-151f3684b6a9</entry>
Nov 14 13:01:01 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:01:01 user nova-compute[75258]:     </system>
Nov 14 13:01:01 user nova-compute[75258]:   </sysinfo>
Nov 14 13:01:01 user nova-compute[75258]:   <os>
Nov 14 13:01:01 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:01:01 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:01:01 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:01:01 user nova-compute[75258]:   </os>
Nov 14 13:01:01 user nova-compute[75258]:   <features>
Nov 14 13:01:01 user nova-compute[75258]:     <acpi/>
Nov 14 13:01:01 user nova-compute[75258]:     <apic/>
Nov 14 13:01:01 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:01:01 user nova-compute[75258]:   </features>
Nov 14 13:01:01 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:01:01 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:01:01 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:01:01 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:01:01 user nova-compute[75258]:   </clock>
Nov 14 13:01:01 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:01:01 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:01:01 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:01:01 user nova-compute[75258]:   </cpu>
Nov 14 13:01:01 user nova-compute[75258]:   <devices>
Nov 14 13:01:01 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:01:01 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:01:01 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk"/>
Nov 14 13:01:01 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:01:01 user nova-compute[75258]:     </disk>
Nov 14 13:01:01 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:01:01 user nova-compute[75258]:       <mac address="fa:16:3e:f3:6d:a1"/>
Nov 14 13:01:01 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:01:01 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:01:01 user nova-compute[75258]:       <target dev="tapef42907d-c9"/>
Nov 14 13:01:01 user nova-compute[75258]:     </interface>
Nov 14 13:01:01 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:01:01 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/console.log" append="off"/>
Nov 14 13:01:01 user nova-compute[75258]:     </serial>
Nov 14 13:01:01 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:01:01 user nova-compute[75258]:     <video>
Nov 14 13:01:01 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:01:01 user nova-compute[75258]:     </video>
Nov 14 13:01:01 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:01:01 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:01:01 user nova-compute[75258]:     </rng>
Nov 14 13:01:01 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:01:01 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:01:01 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:01:01 user nova-compute[75258]:     </memballoon>
Nov 14 13:01:01 user nova-compute[75258]:   </devices>
Nov 14 13:01:01 user nova-compute[75258]: </domain>
Nov 14 13:01:01 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-450070849',display_name='tempest-AttachVolumeNegativeTest-server-450070849',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-450070849',id=39,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9hsjklcK5NwB/2zHV4cK/8yeRXldhHXokx0fJwISdYStx8SXG5St/+tP86PtxlyW8Xmoh6XymHASsXnF80XkYQ2jrN6TctmIEYUGEL3c13L9t54X21+SebsZOBtO2oEQ==',key_name='tempest-keypair-1428488612',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-8isqjlk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:00:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=ce45b26c-7df5-415f-9fbb-151f3684b6a9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:a1,bridge_name='br-int',has_traffic_filtering=True,id=ef42907d-c912-4956-afed-14d8c9a6fdc3,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef42907d-c9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG os_vif [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:a1,bridge_name='br-int',has_traffic_filtering=True,id=ef42907d-c912-4956-afed-14d8c9a6fdc3,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef42907d-c9') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '936490ad-1aec-5abf-8c90-e1ee8f5d690c', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef42907d-c9, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapef42907d-c9, col_values=(('qos', UUID('e2b7f3e0-1cf9-4ada-9ad1-f406e9a47840')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapef42907d-c9, col_values=(('external_ids', {'iface-id': 'ef42907d-c912-4956-afed-14d8c9a6fdc3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f3:6d:a1', 'vm-uuid': 'ce45b26c-7df5-415f-9fbb-151f3684b6a9'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:01 user nova-compute[75258]: INFO os_vif [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f3:6d:a1,bridge_name='br-int',has_traffic_filtering=True,id=ef42907d-c912-4956-afed-14d8c9a6fdc3,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef42907d-c9')
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No VIF found with MAC fa:16:3e:f3:6d:a1, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updated VIF entry in instance network info cache for port ef42907d-c912-4956-afed-14d8c9a6fdc3. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updating instance_info_cache with network_info: [{"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:01:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6f51ebf-e765-47e4-9f41-6ae0ac123d4a req-226fe192-44cf-4e4c-a904-c020e5c584a1 service nova] Releasing lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-593fccde-0214-4c28-b00e-05889b2ee761 req-99ce0b17-1818-4c66-b6b0-bf26172fa84c service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-593fccde-0214-4c28-b00e-05889b2ee761 req-99ce0b17-1818-4c66-b6b0-bf26172fa84c service nova] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-593fccde-0214-4c28-b00e-05889b2ee761 req-99ce0b17-1818-4c66-b6b0-bf26172fa84c service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-593fccde-0214-4c28-b00e-05889b2ee761 req-99ce0b17-1818-4c66-b6b0-bf26172fa84c service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-593fccde-0214-4c28-b00e-05889b2ee761 req-99ce0b17-1818-4c66-b6b0-bf26172fa84c service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] No waiting events found dispatching network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:01:02 user nova-compute[75258]: WARNING nova.compute.manager [req-593fccde-0214-4c28-b00e-05889b2ee761 req-99ce0b17-1818-4c66-b6b0-bf26172fa84c service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received unexpected event network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 for instance with vm_state building and task_state spawning.
Nov 14 13:01:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:01:04 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Instance spawned successfully.
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:04 user nova-compute[75258]: INFO nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Took 5.50 seconds to spawn the instance on the hypervisor.
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-10ac674e-508b-48bd-b276-d19def8d8d7b req-8d37a38c-2ef8-4e2e-975d-5e58cf36f8b3 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-10ac674e-508b-48bd-b276-d19def8d8d7b req-8d37a38c-2ef8-4e2e-975d-5e58cf36f8b3 service nova] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-10ac674e-508b-48bd-b276-d19def8d8d7b req-8d37a38c-2ef8-4e2e-975d-5e58cf36f8b3 service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-10ac674e-508b-48bd-b276-d19def8d8d7b req-8d37a38c-2ef8-4e2e-975d-5e58cf36f8b3 service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-10ac674e-508b-48bd-b276-d19def8d8d7b req-8d37a38c-2ef8-4e2e-975d-5e58cf36f8b3 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] No waiting events found dispatching network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:01:04 user nova-compute[75258]: WARNING nova.compute.manager [req-10ac674e-508b-48bd-b276-d19def8d8d7b req-8d37a38c-2ef8-4e2e-975d-5e58cf36f8b3 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received unexpected event network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 for instance with vm_state building and task_state spawning.
Nov 14 13:01:04 user nova-compute[75258]: INFO nova.compute.manager [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Took 6.15 seconds to build instance.
Nov 14 13:01:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4ad6a0cc-1912-479e-8a21-22bbb68b83f8 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.238s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:14 user nova-compute[75258]: INFO nova.compute.manager [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Terminating instance
Nov 14 13:01:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-cbd31e40-e7ca-4e2d-b9ed-b372aac331de req-d5cda315-7c1c-4a53-80ef-54953f6d1a6d service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-vif-unplugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbd31e40-e7ca-4e2d-b9ed-b372aac331de req-d5cda315-7c1c-4a53-80ef-54953f6d1a6d service nova] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbd31e40-e7ca-4e2d-b9ed-b372aac331de req-d5cda315-7c1c-4a53-80ef-54953f6d1a6d service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbd31e40-e7ca-4e2d-b9ed-b372aac331de req-d5cda315-7c1c-4a53-80ef-54953f6d1a6d service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-cbd31e40-e7ca-4e2d-b9ed-b372aac331de req-d5cda315-7c1c-4a53-80ef-54953f6d1a6d service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] No waiting events found dispatching network-vif-unplugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:01:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-cbd31e40-e7ca-4e2d-b9ed-b372aac331de req-d5cda315-7c1c-4a53-80ef-54953f6d1a6d service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-vif-unplugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:01:15 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Instance destroyed successfully.
Nov 14 13:01:15 user nova-compute[75258]: DEBUG nova.objects.instance [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lazy-loading 'resources' on Instance uuid dc99e2bd-9c7e-4b04-a92a-8be01f6db176 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:43:13Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1259879842',display_name='tempest-ServerActionsTestOtherA-server-1259879842',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1259879842',id=21,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEMLx+8ImNpwKvLhvwr/i9lSjtcCzkDV7vabsonY+tKTReFRnEGJJxQNkJl1FYmmC6nfLUsR1sJbfzvlOCbD2/bJSIbGmEDDztqfnUrdOSbt2+Rw85ssz3zfMBwz3zSjSA==',key_name='tempest-keypair-1938933929',keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:43:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='a6dc8f5ff4bf4a4788a2f7ec14b844f5',ramdisk_id='',reservation_id='r-mjtjmlw0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1553354563',owner_user_name='tempest-ServerActionsTestOtherA-1553354563-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:43:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='974df2b5a20f414eadb9e84383523e4f',uuid=dc99e2bd-9c7e-4b04-a92a-8be01f6db176,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converting VIF {"id": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "address": "fa:16:3e:b7:01:92", "network": {"id": "eee80e16-505b-4795-a192-3f737524cd49", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1644040768-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "a6dc8f5ff4bf4a4788a2f7ec14b844f5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7b7400d1-ea", "ovs_interfaceid": "7b7400d1-ea22-4c63-8d3d-f4040b0eca9d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b7:01:92,bridge_name='br-int',has_traffic_filtering=True,id=7b7400d1-ea22-4c63-8d3d-f4040b0eca9d,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7400d1-ea') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG os_vif [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:01:92,bridge_name='br-int',has_traffic_filtering=True,id=7b7400d1-ea22-4c63-8d3d-f4040b0eca9d,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7400d1-ea') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7b7400d1-ea, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=07cc587f-7812-4201-93d8-f7930e89fb8a) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:15 user nova-compute[75258]: INFO os_vif [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b7:01:92,bridge_name='br-int',has_traffic_filtering=True,id=7b7400d1-ea22-4c63-8d3d-f4040b0eca9d,network=Network(eee80e16-505b-4795-a192-3f737524cd49),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7b7400d1-ea')
Nov 14 13:01:15 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Deleting instance files /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176_del
Nov 14 13:01:15 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Deletion of /opt/stack/data/nova/instances/dc99e2bd-9c7e-4b04-a92a-8be01f6db176_del complete
Nov 14 13:01:15 user nova-compute[75258]: INFO nova.compute.manager [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Took 0.86 seconds to destroy the instance on the hypervisor.
Nov 14 13:01:15 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:01:15 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:01:15 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Took 0.52 seconds to deallocate network for instance.
Nov 14 13:01:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.307s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:16 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Deleted allocations for instance dc99e2bd-9c7e-4b04-a92a-8be01f6db176
Nov 14 13:01:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-39c32aa1-0ff8-4bed-a155-e75ab80d4797 tempest-ServerActionsTestOtherA-1553354563 tempest-ServerActionsTestOtherA-1553354563-project-member] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.874s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-f7543ffa-b274-46c8-a7aa-dfebdeed621b req-07159e2f-b346-4cab-9b10-7589ca982efb service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f7543ffa-b274-46c8-a7aa-dfebdeed621b req-07159e2f-b346-4cab-9b10-7589ca982efb service nova] Acquiring lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f7543ffa-b274-46c8-a7aa-dfebdeed621b req-07159e2f-b346-4cab-9b10-7589ca982efb service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f7543ffa-b274-46c8-a7aa-dfebdeed621b req-07159e2f-b346-4cab-9b10-7589ca982efb service nova] Lock "dc99e2bd-9c7e-4b04-a92a-8be01f6db176-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-f7543ffa-b274-46c8-a7aa-dfebdeed621b req-07159e2f-b346-4cab-9b10-7589ca982efb service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] No waiting events found dispatching network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:01:16 user nova-compute[75258]: WARNING nova.compute.manager [req-f7543ffa-b274-46c8-a7aa-dfebdeed621b req-07159e2f-b346-4cab-9b10-7589ca982efb service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received unexpected event network-vif-plugged-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d for instance with vm_state deleted and task_state None.
Nov 14 13:01:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-f7543ffa-b274-46c8-a7aa-dfebdeed621b req-07159e2f-b346-4cab-9b10-7589ca982efb service nova] [instance: dc99e2bd-9c7e-4b04-a92a-8be01f6db176] Received event network-vif-deleted-7b7400d1-ea22-4c63-8d3d-f4040b0eca9d {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:01:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:01:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:01:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:01:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updating instance_info_cache with network_info: [{"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:01:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:01:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:01:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:28 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:32 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:34 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:01:34 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8719MB free_disk=25.123641967773438GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ed1e7666-fb0f-42a1-8034-cb2d1a845f03 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:35 user nova-compute[75258]: INFO nova.compute.manager [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Terminating instance
Nov 14 13:01:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Instance destroyed successfully.
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lazy-loading 'resources' on Instance uuid ed1e7666-fb0f-42a1-8034-cb2d1a845f03 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:59:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1406777164',display_name='tempest-ServersNegativeTestJSON-server-1406777164',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1406777164',id=38,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:59:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25cb1c380db14d12848d79ba9982681c',ramdisk_id='',reservation_id='r-dw9igffo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-8951680',owner_user_name='tempest-ServersNegativeTestJSON-8951680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:59:51Z,user_data=None,user_id='efce5644ae184c458b7fe8e3ef4c66da',uuid=ed1e7666-fb0f-42a1-8034-cb2d1a845f03,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converting VIF {"id": "4e10a25f-efe1-46ff-b066-973f400a5396", "address": "fa:16:3e:0f:84:bf", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4e10a25f-ef", "ovs_interfaceid": "4e10a25f-efe1-46ff-b066-973f400a5396", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:84:bf,bridge_name='br-int',has_traffic_filtering=True,id=4e10a25f-efe1-46ff-b066-973f400a5396,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e10a25f-ef') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG os_vif [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:84:bf,bridge_name='br-int',has_traffic_filtering=True,id=4e10a25f-efe1-46ff-b066-973f400a5396,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e10a25f-ef') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4e10a25f-ef, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=435000f3-cda6-465c-a138-5d12cbc36420) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:36 user nova-compute[75258]: INFO os_vif [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:84:bf,bridge_name='br-int',has_traffic_filtering=True,id=4e10a25f-efe1-46ff-b066-973f400a5396,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4e10a25f-ef')
Nov 14 13:01:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Deleting instance files /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03_del
Nov 14 13:01:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Deletion of /opt/stack/data/nova/instances/ed1e7666-fb0f-42a1-8034-cb2d1a845f03_del complete
Nov 14 13:01:36 user nova-compute[75258]: INFO nova.compute.manager [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Took 0.65 seconds to destroy the instance on the hypervisor.
Nov 14 13:01:36 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:01:36 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Took 0.42 seconds to deallocate network for instance.
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-a7a8983c-d810-4713-a60a-3ed4e9cb8aeb req-7345d88f-03a4-4650-a142-5778a9ef9b0c service nova] [instance: ed1e7666-fb0f-42a1-8034-cb2d1a845f03] Received event network-vif-deleted-4e10a25f-efe1-46ff-b066-973f400a5396 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:01:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.205s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:36 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Deleted allocations for instance ed1e7666-fb0f-42a1-8034-cb2d1a845f03
Nov 14 13:01:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3624cc64-d0c9-4fc0-9852-f177d7444a85 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "ed1e7666-fb0f-42a1-8034-cb2d1a845f03" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.470s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:01:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:01:46 user nova-compute[75258]: INFO nova.compute.claims [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Claim successful on node user
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.222s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:01:47 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:01:47 user nova-compute[75258]: INFO nova.virt.block_device [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Booting with volume fb718c6a-0685-423b-9689-bae065ae7de1 at /dev/vda
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.policy [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5d3e776b6ec84a2bb1e7b70fc28ccb6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fdb669e737b040988bfb4be1d740f9f1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG os_brick.utils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daaaed6-e934-4557-9951-239e8e6ee200]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb2ebc63-a017-4962-b3a1-39759cfcfa51]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[183e4277-a468-4354-a32b-53f0887b0331]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dae23c-d784-4a91-9c60-02345f997725]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:01:47 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:01:47 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9aa0b58-5f5a-4947-9368-ac39fe990a8b]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG os_brick.utils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] <== get_connector_properties: return (124ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:01:47 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating existing volume attachment record: 9df93c27-e4bb-4ee7-993d-c9c69e01ef3c {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Successfully created port: a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Successfully updated port: a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG nova.compute.manager [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing instance network info cache due to event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:01:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance network_info: |[{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updated VIF entry in instance network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG nova.network.neutron [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fbebf403-ed2e-46cd-8ab5-5f13be920878 req-d3dcaf60-4d4f-466f-823b-0758e7d179cd service nova] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:01:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:01:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Creating image(s)
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Ensure instance console log exists: /opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Start _get_guest_xml network_info=[{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb718c6a-0685-423b-9689-bae065ae7de1', 'serial': 'fb718c6a-0685-423b-9689-bae065ae7de1'}, 'device_type': 'disk', 'attachment_id': '9df93c27-e4bb-4ee7-993d-c9c69e01ef3c', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:01:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:01:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:01:51 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:01:51 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:01:51 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7363366-4308-4eb2-b777-b220c7b87723]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:01:51 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[18a08bdf-247e-4d31-ad6c-33d161260475]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1] added
Nov 14 13:01:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da19fc7-1459-43b5-8c48-d4e36aea9fc0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ae8c61-d202-4e09-a91f-6d4089cacbb7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afqdnRpv {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afqdnRpv" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8798715f-ba95-4148-93ac-60bb65efa211]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afqdnRpv'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7818543c-07a5-4e2a-80f1-54e46fbaccee]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9882df-b176-4c11-adcd-3b6ba955517c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:01:51 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:01:51 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:01:51 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:01:51 user nova-compute[75258]: 
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8357c66-880c-42f3-9d34-4bc3d52ad6a0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]
Nov 14 13:01:51 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.
Nov 14 13:01:51 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:51 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc64c79b-bff3-4795-8152-b38b13c9d4ca]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b68ff6e0-1d6c-4069-aaff-b4f99a888469]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:01:52 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:01:52 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] HCTL ('33', '-', '-', 0) found on session 52 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[840a3f0b-f8f3-40e0-a5b7-58b15f694f5d]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Searching for a device in session 52 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:01:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '23166323733376338', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166323733376338', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097283832',display_name='tempest-TestShelveInstance-server-2097283832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2097283832',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI+9X2TV9rdUZKl4RBR8c8B50/XUrW11gncjFra8lGpCL05B0NDLWa04nMF4GQ05xUxhgWWyZvjJPxXZIiqcPB/4Z4nWJRPUKxSPKqO0/dnHEoSQvDDOKkfDkRwfgRrBg==',key_name='tempest-TestShelveInstance-1373538128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb669e737b040988bfb4be1d740f9f1',ramdisk_id='',reservation_id='r-l6b45rin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-803522430',owner_user_name='tempest-TestShelveInstance-803522430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:01:47Z,user_data=None,user_id='5d3e776b6ec84a2bb1e7b70fc28ccb6e',uuid=abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converting VIF {"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.objects.instance [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'pci_devices' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:01:53 user nova-compute[75258]:   <uuid>abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3</uuid>
Nov 14 13:01:53 user nova-compute[75258]:   <name>instance-00000028</name>
Nov 14 13:01:53 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:01:53 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:01:53 user nova-compute[75258]:   <metadata>
Nov 14 13:01:53 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:01:53 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:01:53 user nova-compute[75258]:       <nova:name>tempest-TestShelveInstance-server-2097283832</nova:name>
Nov 14 13:01:53 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:01:51</nova:creationTime>
Nov 14 13:01:53 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:01:53 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:01:53 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:01:53 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:01:53 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:01:53 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:01:53 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:01:53 user nova-compute[75258]:       <nova:owner>
Nov 14 13:01:53 user nova-compute[75258]:         <nova:user uuid="5d3e776b6ec84a2bb1e7b70fc28ccb6e">tempest-TestShelveInstance-803522430-project-member</nova:user>
Nov 14 13:01:53 user nova-compute[75258]:         <nova:project uuid="fdb669e737b040988bfb4be1d740f9f1">tempest-TestShelveInstance-803522430</nova:project>
Nov 14 13:01:53 user nova-compute[75258]:       </nova:owner>
Nov 14 13:01:53 user nova-compute[75258]:       <nova:ports>
Nov 14 13:01:53 user nova-compute[75258]:         <nova:port uuid="a5d0ccce-a99a-45fd-a681-6678fe2be613">
Nov 14 13:01:53 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 13:01:53 user nova-compute[75258]:         </nova:port>
Nov 14 13:01:53 user nova-compute[75258]:       </nova:ports>
Nov 14 13:01:53 user nova-compute[75258]:     </nova:instance>
Nov 14 13:01:53 user nova-compute[75258]:   </metadata>
Nov 14 13:01:53 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:01:53 user nova-compute[75258]:     <system>
Nov 14 13:01:53 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:01:53 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:01:53 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:01:53 user nova-compute[75258]:       <entry name="serial">abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3</entry>
Nov 14 13:01:53 user nova-compute[75258]:       <entry name="uuid">abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3</entry>
Nov 14 13:01:53 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:01:53 user nova-compute[75258]:     </system>
Nov 14 13:01:53 user nova-compute[75258]:   </sysinfo>
Nov 14 13:01:53 user nova-compute[75258]:   <os>
Nov 14 13:01:53 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:01:53 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:01:53 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:01:53 user nova-compute[75258]:   </os>
Nov 14 13:01:53 user nova-compute[75258]:   <features>
Nov 14 13:01:53 user nova-compute[75258]:     <acpi/>
Nov 14 13:01:53 user nova-compute[75258]:     <apic/>
Nov 14 13:01:53 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:01:53 user nova-compute[75258]:   </features>
Nov 14 13:01:53 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:01:53 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:01:53 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:01:53 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:01:53 user nova-compute[75258]:   </clock>
Nov 14 13:01:53 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:01:53 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:01:53 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:01:53 user nova-compute[75258]:   </cpu>
Nov 14 13:01:53 user nova-compute[75258]:   <devices>
Nov 14 13:01:53 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:01:53 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:01:53 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 13:01:53 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:01:53 user nova-compute[75258]:       <serial>fb718c6a-0685-423b-9689-bae065ae7de1</serial>
Nov 14 13:01:53 user nova-compute[75258]:     </disk>
Nov 14 13:01:53 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:01:53 user nova-compute[75258]:       <mac address="fa:16:3e:01:51:45"/>
Nov 14 13:01:53 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:01:53 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:01:53 user nova-compute[75258]:       <target dev="tapa5d0ccce-a9"/>
Nov 14 13:01:53 user nova-compute[75258]:     </interface>
Nov 14 13:01:53 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:01:53 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3/console.log" append="off"/>
Nov 14 13:01:53 user nova-compute[75258]:     </serial>
Nov 14 13:01:53 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:01:53 user nova-compute[75258]:     <video>
Nov 14 13:01:53 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:01:53 user nova-compute[75258]:     </video>
Nov 14 13:01:53 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:01:53 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:01:53 user nova-compute[75258]:     </rng>
Nov 14 13:01:53 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:01:53 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:01:53 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:01:53 user nova-compute[75258]:     </memballoon>
Nov 14 13:01:53 user nova-compute[75258]:   </devices>
Nov 14 13:01:53 user nova-compute[75258]: </domain>
Nov 14 13:01:53 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097283832',display_name='tempest-TestShelveInstance-server-2097283832',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2097283832',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI+9X2TV9rdUZKl4RBR8c8B50/XUrW11gncjFra8lGpCL05B0NDLWa04nMF4GQ05xUxhgWWyZvjJPxXZIiqcPB/4Z4nWJRPUKxSPKqO0/dnHEoSQvDDOKkfDkRwfgRrBg==',key_name='tempest-TestShelveInstance-1373538128',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='fdb669e737b040988bfb4be1d740f9f1',ramdisk_id='',reservation_id='r-l6b45rin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-803522430',owner_user_name='tempest-TestShelveInstance-803522430-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:01:47Z,user_data=None,user_id='5d3e776b6ec84a2bb1e7b70fc28ccb6e',uuid=abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converting VIF {"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG os_vif [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29181849-c834-5f1f-8193-14b925147556', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5d0ccce-a9, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5d0ccce-a9, col_values=(('qos', UUID('c27944a2-1b15-44fd-917c-e51e30505eeb')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5d0ccce-a9, col_values=(('external_ids', {'iface-id': 'a5d0ccce-a99a-45fd-a681-6678fe2be613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:51:45', 'vm-uuid': 'abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:53 user nova-compute[75258]: INFO os_vif [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9')
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:01:53 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] No VIF found with MAC fa:16:3e:01:51:45, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-41e3d649-13d3-45a2-8854-fabe35ca6b9f req-33343395-7148-4e15-a24e-00f7257c9715 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41e3d649-13d3-45a2-8854-fabe35ca6b9f req-33343395-7148-4e15-a24e-00f7257c9715 service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41e3d649-13d3-45a2-8854-fabe35ca6b9f req-33343395-7148-4e15-a24e-00f7257c9715 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41e3d649-13d3-45a2-8854-fabe35ca6b9f req-33343395-7148-4e15-a24e-00f7257c9715 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-41e3d649-13d3-45a2-8854-fabe35ca6b9f req-33343395-7148-4e15-a24e-00f7257c9715 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:01:54 user nova-compute[75258]: WARNING nova.compute.manager [req-41e3d649-13d3-45a2-8854-fabe35ca6b9f req-33343395-7148-4e15-a24e-00f7257c9715 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state building and task_state spawning.
Nov 14 13:01:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:01:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance spawned successfully.
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:01:56 user nova-compute[75258]: INFO nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-f03df24d-26d9-4184-82ba-f2f399d7373c req-e15cf228-6b59-4de4-96fa-36007c927ccc service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f03df24d-26d9-4184-82ba-f2f399d7373c req-e15cf228-6b59-4de4-96fa-36007c927ccc service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f03df24d-26d9-4184-82ba-f2f399d7373c req-e15cf228-6b59-4de4-96fa-36007c927ccc service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f03df24d-26d9-4184-82ba-f2f399d7373c req-e15cf228-6b59-4de4-96fa-36007c927ccc service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-f03df24d-26d9-4184-82ba-f2f399d7373c req-e15cf228-6b59-4de4-96fa-36007c927ccc service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:01:56 user nova-compute[75258]: WARNING nova.compute.manager [req-f03df24d-26d9-4184-82ba-f2f399d7373c req-e15cf228-6b59-4de4-96fa-36007c927ccc service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state building and task_state spawning.
Nov 14 13:01:56 user nova-compute[75258]: INFO nova.compute.manager [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Took 10.07 seconds to build instance.
Nov 14 13:01:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-674967c8-f116-4417-b1d2-806fc19c1cf5 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.218s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:01:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:01:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:02:16 user nova-compute[75258]: INFO nova.compute.claims [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Claim successful on node user
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.260s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:02:16 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.policy [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5106602814f6478fad50a7273995c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b14d580c640bcbbd8ce084f5872a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:02:16 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Creating image(s)
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:02:16 user nova-compute[75258]: INFO nova.compute.claims [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Claim successful on node user
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.211s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk 1073741824" returned: 0 in 0.066s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.280s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Successfully created port: 73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.451s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:02:17 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.policy [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5106602814f6478fad50a7273995c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b14d580c640bcbbd8ce084f5872a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:02:17 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Creating image(s)
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.020s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Cannot resize image /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Ensure instance console log exists: /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Successfully created port: 26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk 1073741824" returned: 0 in 0.063s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Successfully updated port: 73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-changed-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Refreshing instance network info cache due to event network-changed-73ccdfd9-b72c-4945-ac09-05a199745af0. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.223s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Cannot resize image /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Ensure instance console log exists: /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance network_info: |[{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Refreshing network info cache for port 73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Start _get_guest_xml network_info=[{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:02:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:02:18 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494633960',display_name='tempest-ServerRescueNegativeTestJSON-server-494633960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494633960',id=41,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-fh3gql35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:02:17Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=6f4e59bf-246f-4490-8c6a-71b39185fc17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Successfully updated port: 26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-changed-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Refreshing instance network info cache due to event network-changed-26b28578-229d-4ad6-8ae4-d088ef0016f9. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] Acquiring lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] Acquired lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Refreshing network info cache for port 26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:02:18 user nova-compute[75258]:   <uuid>6f4e59bf-246f-4490-8c6a-71b39185fc17</uuid>
Nov 14 13:02:18 user nova-compute[75258]:   <name>instance-00000029</name>
Nov 14 13:02:18 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:02:18 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:02:18 user nova-compute[75258]:   <metadata>
Nov 14 13:02:18 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:02:18 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:02:18 user nova-compute[75258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-494633960</nova:name>
Nov 14 13:02:18 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:02:18</nova:creationTime>
Nov 14 13:02:18 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:02:18 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:02:18 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:02:18 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:02:18 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:02:18 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:02:18 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:02:18 user nova-compute[75258]:       <nova:owner>
Nov 14 13:02:18 user nova-compute[75258]:         <nova:user uuid="5106602814f6478fad50a7273995c8b9">tempest-ServerRescueNegativeTestJSON-607907589-project-member</nova:user>
Nov 14 13:02:18 user nova-compute[75258]:         <nova:project uuid="2b1b14d580c640bcbbd8ce084f5872a2">tempest-ServerRescueNegativeTestJSON-607907589</nova:project>
Nov 14 13:02:18 user nova-compute[75258]:       </nova:owner>
Nov 14 13:02:18 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:02:18 user nova-compute[75258]:       <nova:ports>
Nov 14 13:02:18 user nova-compute[75258]:         <nova:port uuid="73ccdfd9-b72c-4945-ac09-05a199745af0">
Nov 14 13:02:18 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 13:02:18 user nova-compute[75258]:         </nova:port>
Nov 14 13:02:18 user nova-compute[75258]:       </nova:ports>
Nov 14 13:02:18 user nova-compute[75258]:     </nova:instance>
Nov 14 13:02:18 user nova-compute[75258]:   </metadata>
Nov 14 13:02:18 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:02:18 user nova-compute[75258]:     <system>
Nov 14 13:02:18 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:02:18 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:02:18 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:02:18 user nova-compute[75258]:       <entry name="serial">6f4e59bf-246f-4490-8c6a-71b39185fc17</entry>
Nov 14 13:02:18 user nova-compute[75258]:       <entry name="uuid">6f4e59bf-246f-4490-8c6a-71b39185fc17</entry>
Nov 14 13:02:18 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:02:18 user nova-compute[75258]:     </system>
Nov 14 13:02:18 user nova-compute[75258]:   </sysinfo>
Nov 14 13:02:18 user nova-compute[75258]:   <os>
Nov 14 13:02:18 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:02:18 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:02:18 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:02:18 user nova-compute[75258]:   </os>
Nov 14 13:02:18 user nova-compute[75258]:   <features>
Nov 14 13:02:18 user nova-compute[75258]:     <acpi/>
Nov 14 13:02:18 user nova-compute[75258]:     <apic/>
Nov 14 13:02:18 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:02:18 user nova-compute[75258]:   </features>
Nov 14 13:02:18 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:02:18 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:02:18 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:02:18 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:02:18 user nova-compute[75258]:   </clock>
Nov 14 13:02:18 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:02:18 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:02:18 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:02:18 user nova-compute[75258]:   </cpu>
Nov 14 13:02:18 user nova-compute[75258]:   <devices>
Nov 14 13:02:18 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:02:18 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:02:18 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk"/>
Nov 14 13:02:18 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:02:18 user nova-compute[75258]:     </disk>
Nov 14 13:02:18 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:02:18 user nova-compute[75258]:       <mac address="fa:16:3e:e0:e9:74"/>
Nov 14 13:02:18 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:02:18 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:02:18 user nova-compute[75258]:       <target dev="tap73ccdfd9-b7"/>
Nov 14 13:02:18 user nova-compute[75258]:     </interface>
Nov 14 13:02:18 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:02:18 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/console.log" append="off"/>
Nov 14 13:02:18 user nova-compute[75258]:     </serial>
Nov 14 13:02:18 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:02:18 user nova-compute[75258]:     <video>
Nov 14 13:02:18 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:02:18 user nova-compute[75258]:     </video>
Nov 14 13:02:18 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:02:18 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:02:18 user nova-compute[75258]:     </rng>
Nov 14 13:02:18 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:02:18 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:02:18 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:02:18 user nova-compute[75258]:     </memballoon>
Nov 14 13:02:18 user nova-compute[75258]:   </devices>
Nov 14 13:02:18 user nova-compute[75258]: </domain>
Nov 14 13:02:18 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494633960',display_name='tempest-ServerRescueNegativeTestJSON-server-494633960',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494633960',id=41,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-fh3gql35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:02:17Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=6f4e59bf-246f-4490-8c6a-71b39185fc17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG os_vif [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '801ad0ac-6e90-5ce4-89d0-be2077475ab8', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap73ccdfd9-b7, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap73ccdfd9-b7, col_values=(('qos', UUID('1b7fe84d-b551-4242-93f6-31a45f0d40b9')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap73ccdfd9-b7, col_values=(('external_ids', {'iface-id': '73ccdfd9-b72c-4945-ac09-05a199745af0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e0:e9:74', 'vm-uuid': '6f4e59bf-246f-4490-8c6a-71b39185fc17'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:18 user nova-compute[75258]: INFO os_vif [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7')
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.network.neutron [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:02:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No VIF found with MAC fa:16:3e:e0:e9:74, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-13ea9209-2238-40b9-a6aa-a94c0ee3c3ea req-380a817f-8b92-41b0-ad9f-111181acb0bc service nova] Releasing lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updated VIF entry in instance network info cache for port 73ccdfd9-b72c-4945-ac09-05a199745af0. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f935cc7d-2d57-43ed-bb20-157e099e40cb req-8d36dd55-aab2-4281-befa-e0db21f628db service nova] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance network_info: |[{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Start _get_guest_xml network_info=[{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:02:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:02:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2095679056',display_name='tempest-ServerRescueNegativeTestJSON-server-2095679056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2095679056',id=42,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-x3pfcjkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:02:18Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=2fb87e79-f7a8-4bfc-924f-cec1e3d45268,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.objects.instance [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:02:19 user nova-compute[75258]:   <uuid>2fb87e79-f7a8-4bfc-924f-cec1e3d45268</uuid>
Nov 14 13:02:19 user nova-compute[75258]:   <name>instance-0000002a</name>
Nov 14 13:02:19 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:02:19 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:02:19 user nova-compute[75258]:   <metadata>
Nov 14 13:02:19 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:02:19 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:02:19 user nova-compute[75258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2095679056</nova:name>
Nov 14 13:02:19 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:02:19</nova:creationTime>
Nov 14 13:02:19 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:02:19 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:02:19 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:02:19 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:02:19 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:02:19 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:02:19 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:02:19 user nova-compute[75258]:       <nova:owner>
Nov 14 13:02:19 user nova-compute[75258]:         <nova:user uuid="5106602814f6478fad50a7273995c8b9">tempest-ServerRescueNegativeTestJSON-607907589-project-member</nova:user>
Nov 14 13:02:19 user nova-compute[75258]:         <nova:project uuid="2b1b14d580c640bcbbd8ce084f5872a2">tempest-ServerRescueNegativeTestJSON-607907589</nova:project>
Nov 14 13:02:19 user nova-compute[75258]:       </nova:owner>
Nov 14 13:02:19 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:02:19 user nova-compute[75258]:       <nova:ports>
Nov 14 13:02:19 user nova-compute[75258]:         <nova:port uuid="26b28578-229d-4ad6-8ae4-d088ef0016f9">
Nov 14 13:02:19 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 13:02:19 user nova-compute[75258]:         </nova:port>
Nov 14 13:02:19 user nova-compute[75258]:       </nova:ports>
Nov 14 13:02:19 user nova-compute[75258]:     </nova:instance>
Nov 14 13:02:19 user nova-compute[75258]:   </metadata>
Nov 14 13:02:19 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:02:19 user nova-compute[75258]:     <system>
Nov 14 13:02:19 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:02:19 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:02:19 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:02:19 user nova-compute[75258]:       <entry name="serial">2fb87e79-f7a8-4bfc-924f-cec1e3d45268</entry>
Nov 14 13:02:19 user nova-compute[75258]:       <entry name="uuid">2fb87e79-f7a8-4bfc-924f-cec1e3d45268</entry>
Nov 14 13:02:19 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:02:19 user nova-compute[75258]:     </system>
Nov 14 13:02:19 user nova-compute[75258]:   </sysinfo>
Nov 14 13:02:19 user nova-compute[75258]:   <os>
Nov 14 13:02:19 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:02:19 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:02:19 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:02:19 user nova-compute[75258]:   </os>
Nov 14 13:02:19 user nova-compute[75258]:   <features>
Nov 14 13:02:19 user nova-compute[75258]:     <acpi/>
Nov 14 13:02:19 user nova-compute[75258]:     <apic/>
Nov 14 13:02:19 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:02:19 user nova-compute[75258]:   </features>
Nov 14 13:02:19 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:02:19 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:02:19 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:02:19 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:02:19 user nova-compute[75258]:   </clock>
Nov 14 13:02:19 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:02:19 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:02:19 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:02:19 user nova-compute[75258]:   </cpu>
Nov 14 13:02:19 user nova-compute[75258]:   <devices>
Nov 14 13:02:19 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:02:19 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:02:19 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk"/>
Nov 14 13:02:19 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:02:19 user nova-compute[75258]:     </disk>
Nov 14 13:02:19 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:02:19 user nova-compute[75258]:       <mac address="fa:16:3e:e8:5c:b8"/>
Nov 14 13:02:19 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:02:19 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:02:19 user nova-compute[75258]:       <target dev="tap26b28578-22"/>
Nov 14 13:02:19 user nova-compute[75258]:     </interface>
Nov 14 13:02:19 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:02:19 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/console.log" append="off"/>
Nov 14 13:02:19 user nova-compute[75258]:     </serial>
Nov 14 13:02:19 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:02:19 user nova-compute[75258]:     <video>
Nov 14 13:02:19 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:02:19 user nova-compute[75258]:     </video>
Nov 14 13:02:19 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:02:19 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:02:19 user nova-compute[75258]:     </rng>
Nov 14 13:02:19 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:02:19 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:02:19 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:02:19 user nova-compute[75258]:     </memballoon>
Nov 14 13:02:19 user nova-compute[75258]:   </devices>
Nov 14 13:02:19 user nova-compute[75258]: </domain>
Nov 14 13:02:19 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2095679056',display_name='tempest-ServerRescueNegativeTestJSON-server-2095679056',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2095679056',id=42,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-x3pfcjkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:02:18Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=2fb87e79-f7a8-4bfc-924f-cec1e3d45268,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG os_vif [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c0fdb0d-1550-585e-b878-2dd264a7edf6', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap26b28578-22, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap26b28578-22, col_values=(('qos', UUID('e555a8bd-a09c-4513-b2f3-6603564231cf')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap26b28578-22, col_values=(('external_ids', {'iface-id': '26b28578-229d-4ad6-8ae4-d088ef0016f9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:5c:b8', 'vm-uuid': '2fb87e79-f7a8-4bfc-924f-cec1e3d45268'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:19 user nova-compute[75258]: INFO os_vif [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22')
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No VIF found with MAC fa:16:3e:e8:5c:b8, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:02:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-ea3bfaa7-516b-460d-aff8-d46bdd0ee2b4 req-77123e9c-96c5-41d3-aec6-43f35725dc42 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ea3bfaa7-516b-460d-aff8-d46bdd0ee2b4 req-77123e9c-96c5-41d3-aec6-43f35725dc42 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ea3bfaa7-516b-460d-aff8-d46bdd0ee2b4 req-77123e9c-96c5-41d3-aec6-43f35725dc42 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ea3bfaa7-516b-460d-aff8-d46bdd0ee2b4 req-77123e9c-96c5-41d3-aec6-43f35725dc42 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-ea3bfaa7-516b-460d-aff8-d46bdd0ee2b4 req-77123e9c-96c5-41d3-aec6-43f35725dc42 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:02:20 user nova-compute[75258]: WARNING nova.compute.manager [req-ea3bfaa7-516b-460d-aff8-d46bdd0ee2b4 req-77123e9c-96c5-41d3-aec6-43f35725dc42 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state building and task_state spawning.
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:02:22 user nova-compute[75258]: WARNING nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state building and task_state spawning.
Nov 14 13:02:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:02:22 user nova-compute[75258]: WARNING nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received unexpected event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with vm_state building and task_state spawning.
Nov 14 13:02:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:22 user nova-compute[75258]: DEBUG nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:02:22 user nova-compute[75258]: WARNING nova.compute.manager [req-30ec230d-d278-4cda-b66f-9daa5a734d9b req-1c7818eb-1036-4ce1-aac3-ade9c41b8450 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received unexpected event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with vm_state building and task_state spawning.
Nov 14 13:02:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Skipping network cache update for instance because it is Building. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Skipping network cache update for instance because it is Building. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:02:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance spawned successfully.
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:02:23 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance spawned successfully.
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:02:23 user nova-compute[75258]: INFO nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Took 7.14 seconds to spawn the instance on the hypervisor.
Nov 14 13:02:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:02:24 user nova-compute[75258]: INFO nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Took 6.39 seconds to spawn the instance on the hypervisor.
Nov 14 13:02:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:02:24 user nova-compute[75258]: INFO nova.compute.manager [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Took 7.80 seconds to build instance.
Nov 14 13:02:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updating instance_info_cache with network_info: [{"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:02:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4475dacf-6b00-44ce-8543-c314bf8e5fa0 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.911s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:02:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:02:24 user nova-compute[75258]: INFO nova.compute.manager [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Took 7.25 seconds to build instance.
Nov 14 13:02:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-71f4330b-9446-4216-899b-41c818d455de tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.403s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:02:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8431MB free_disk=25.145816802978516GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:02:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.309s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:02:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:02:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:02:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:02:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:02:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-changed-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG nova.compute.manager [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Refreshing instance network info cache due to event network-changed-ef42907d-c912-4956-afed-14d8c9a6fdc3. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] Acquiring lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] Acquired lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Refreshing network info cache for port ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updated VIF entry in instance network info cache for port ef42907d-c912-4956-afed-14d8c9a6fdc3. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updating instance_info_cache with network_info: [{"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:02:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cbce14fc-b43c-4047-8552-d3991b3a714e req-631a81d4-d03e-4cf0-b045-9afca74ae9fc service nova] Releasing lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:02:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:51 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid ce45b26c-7df5-415f-9fbb-151f3684b6a9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:02:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:51 user nova-compute[75258]: INFO nova.compute.manager [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Attaching volume 6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 to /dev/vdb
Nov 14 13:02:52 user nova-compute[75258]: DEBUG os_brick.utils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c86a0d63-f31b-47a4-9dd5-dd0318ea4b03]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d0d820-ee96-401b-8b70-d9f7e21c2bea]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea753643-2775-44f9-ab5e-5a3da0560656]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ee7542d-e54d-41d5-86cb-c817ce3aab84]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:02:52 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:02:52 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ebded4-79dd-4d07-bd44-52b14b30a1cc]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG os_brick.utils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:02:52 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updating existing volume attachment record: c3ff8b73-bcdb-437c-9017-465fe2210fee {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:02:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBJcZNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:02:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:02:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:02:56 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e771ff11-228d-4f87-97ca-39584e084ab0]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:02:56 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[422cad42-1b91-476f-b8ee-1abf68510802]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72] added
Nov 14 13:02:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[42073ff5-df05-4d28-8476-42bcf31f23ab]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba2e5699-a591-492e-ad51-1adbd1ea87a1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmBJcZNl {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OmBJcZNl" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae77361b-5997-49d3-a732-8bd1fb6ca522]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OmBJcZNl'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3df1c8e6-37a3-4eb5-acf3-517530f6c976]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bffee1-7d1a-4898-b6b0-6aef54e91913]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:02:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:02:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfedf3c9-7943-40fe-9153-bbc061c50e32]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260]
Nov 14 13:02:56 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260] successful.
Nov 14 13:02:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f63951-d59e-4062-89f7-80b674ced327]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8e94c6b-4990-42f4-b6aa-c6cbf961a8df]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:02:56 user nova-compute[75258]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 (non-flash)
Nov 14 13:02:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:02:56 user nova-compute[75258]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 (non-flash)
Nov 14 13:02:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.275s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] HCTL ('34', '-', '-', 0) found on session 53 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c2bcf8-a1be-425b-b573-e4d28a576320]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:02:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Searching for a device in session 53 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBJcZNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.305s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== connect_volume: return (1306ms) {'type': 'block', 'scsi_wwn': '26430633639636130', 'path': '/dev/sdc'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26430633639636130', 'path': '/dev/sdc'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid ce45b26c-7df5-415f-9fbb-151f3684b6a9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 13:02:57 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:02:57 user nova-compute[75258]:   <source dev="/dev/sdc"/>
Nov 14 13:02:57 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:02:57 user nova-compute[75258]:   <serial>6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72</serial>
Nov 14 13:02:57 user nova-compute[75258]: </disk>
Nov 14 13:02:57 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:02:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] No VIF found with MAC fa:16:3e:f3:6d:a1, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:02:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f709a867-322e-4d0d-b2cd-e97f4457f466 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.207s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:02:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:02:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:02:58 user nova-compute[75258]: INFO nova.compute.manager [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Detaching volume 6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72
Nov 14 13:02:58 user nova-compute[75258]: INFO nova.virt.block_device [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Attempting to driver detach volume 6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 from mountpoint /dev/vdb
Nov 14 13:02:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Attempting to detach device vdb from instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 13:02:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:02:58 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:02:58 user nova-compute[75258]:   <source dev="/dev/sdc"/>
Nov 14 13:02:58 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:02:58 user nova-compute[75258]:   <serial>6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72</serial>
Nov 14 13:02:58 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:02:58 user nova-compute[75258]: </disk>
Nov 14 13:02:58 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:02:58 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully detached device vdb from instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 from the persistent domain config.
Nov 14 13:02:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 13:02:58 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:02:58 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:02:58 user nova-compute[75258]:   <source dev="/dev/sdc"/>
Nov 14 13:02:58 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:02:58 user nova-compute[75258]:   <serial>6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72</serial>
Nov 14 13:02:58 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:02:58 user nova-compute[75258]: </disk>
Nov 14 13:02:58 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:02:59 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 13:02:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:02:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 is timed out.
Nov 14 13:03:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully detached device vdb from instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 from the live domain config.
Nov 14 13:03:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OmBJcZNl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:03:19 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf002e67-5798-4d4e-97ca-5e86b014219d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:03:19 user nova-compute[75258]: No targets found.
Nov 14 13:03:19 user nova-compute[75258]: iSNS:
Nov 14 13:03:19 user nova-compute[75258]: No targets found.
Nov 14 13:03:19 user nova-compute[75258]: STATIC:
Nov 14 13:03:19 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1
Nov 14 13:03:19 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:03:19 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:03:19 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72
Nov 14 13:03:19 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:03:19 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:03:19 user nova-compute[75258]: FIRMWARE:
Nov 14 13:03:19 user nova-compute[75258]: No targets found.
Nov 14 13:03:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:03:19 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:03:19 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5870d8a2-6905-48f3-9be8-1d2103987600]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b1428e3-d3c0-4d7c-8382-5a2384299abb]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)\ntcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:03:19 user nova-compute[75258]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 (non-flash)
Nov 14 13:03:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:03:19 user nova-compute[75258]: tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 (non-flash)
Nov 14 13:03:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c5d1ab0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72'): ({'sdc'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Removing single pathed devices sdc {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[80de190e-a976-427e-bfaa-4da0ce7e9ced]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bddfb61-d84b-4aea-90d5-fefef7a2da58]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Flushing IO for device /dev/sdc {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c923206-660e-4bb7-80f7-41e6935f389f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bae448be-182c-4cce-90a3-044aa8d6fb3d]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6048bf65-b088-4886-b8a1-0ec80c59757d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4fcff1-9ed0-443e-bf7e-ccd36f50029e]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260]
Nov 14 13:03:19 user nova-compute[75258]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72, portal: 172.16.0.220,3260] successful.
Nov 14 13:03:19 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6f884e5f-b3ac-46b3-8f59-0ff63f9f4e72 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a16d0bff-a580-4c06-b8d4-73d69822c4e2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] <== disconnect_volume: return (323ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:03:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'flavor' on Instance uuid ce45b26c-7df5-415f-9fbb-151f3684b6a9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f36bea28-f6cf-4bbc-8615-b3f2051b9fd3 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.629s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid ce45b26c-7df5-415f-9fbb-151f3684b6a9 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.039s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.049s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.044s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.056s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:03:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:03:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:03:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:03:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updating instance_info_cache with network_info: [{"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-ce45b26c-7df5-415f-9fbb-151f3684b6a9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:03:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:03:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:28 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:03:35 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8516MB free_disk=25.088977813720703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance ce45b26c-7df5-415f-9fbb-151f3684b6a9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:03:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.455s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing instance network info cache due to event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:03:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:03:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:03:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:03:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:39 user nova-compute[75258]: INFO nova.compute.manager [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Shelve offloading
Nov 14 13:03:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG nova.network.neutron [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updated VIF entry in instance network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG nova.network.neutron [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-78931ea4-7ad8-47a3-b6ad-71173729344f req-bffd6891-0950-4333-b42c-55c74a6cd10d service nova] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:03:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance destroyed successfully.
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:40 user nova-compute[75258]: WARNING nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state shelving.
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:40 user nova-compute[75258]: WARNING nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state shelving.
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:40 user nova-compute[75258]: WARNING nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state shelving.
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:40 user nova-compute[75258]: WARNING nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state shelving.
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:40 user nova-compute[75258]: WARNING nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state shelving.
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:40 user nova-compute[75258]: WARNING nova.compute.manager [req-eada26f3-45d2-43f1-97b8-b46e6553cb66 req-ab446a03-1a39-48f4-985a-cd32aff8615a service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state shelving.
Nov 14 13:03:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance destroyed successfully.
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'resources' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097283832',display_name='tempest-TestShelveInstance-server-2097283832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2097283832',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI+9X2TV9rdUZKl4RBR8c8B50/XUrW11gncjFra8lGpCL05B0NDLWa04nMF4GQ05xUxhgWWyZvjJPxXZIiqcPB/4Z4nWJRPUKxSPKqO0/dnHEoSQvDDOKkfDkRwfgRrBg==',key_name='tempest-TestShelveInstance-1373538128',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:01:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb669e737b040988bfb4be1d740f9f1',ramdisk_id='',reservation_id='r-l6b45rin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-803522430',owner_user_name='tempest-TestShelveInstance-803522430-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:01:57Z,user_data=None,user_id='5d3e776b6ec84a2bb1e7b70fc28ccb6e',uuid=abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converting VIF {"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_vif [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5d0ccce-a9, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.compute.manager [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing instance network info cache due to event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c27944a2-1b15-44fd-917c-e51e30505eeb) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:03:41 user nova-compute[75258]: INFO os_vif [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9')
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:03:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[324c78af-0b1d-4ad1-ad57-88197b47657d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:03:41 user nova-compute[75258]: No targets found.
Nov 14 13:03:41 user nova-compute[75258]: iSNS:
Nov 14 13:03:41 user nova-compute[75258]: No targets found.
Nov 14 13:03:41 user nova-compute[75258]: STATIC:
Nov 14 13:03:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1
Nov 14 13:03:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:03:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:03:41 user nova-compute[75258]: FIRMWARE:
Nov 14 13:03:41 user nova-compute[75258]: No targets found.
Nov 14 13:03:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:03:41 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:03:41 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[869b625b-64fa-48ad-8490-9597a3351faa]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[38750e84-0ec1-4f83-a486-67e1d8fd678a]: (4, ('tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:03:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsi session list stdout=tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:03:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b4277ac0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[655c65af-b74e-4992-8c99-2ac237fb7e62]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf75914-30c9-4d48-bd82-18b8c97c4b78]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[efbd4d94-2b27-4151-8ed0-cf717d87b422]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.044s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bdb55c-2860-40f1-b453-f1e2aa57ebe0]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4651d7b0-9e89-4d06-b331-a8546d3791a3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf21689d-9b03-489a-a8f5-cf173f2b1d3c]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]
Nov 14 13:03:41 user nova-compute[75258]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.
Nov 14 13:03:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eae376a7-30a0-44da-984c-82124147f5e5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.297s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] <== disconnect_volume: return (298ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:03:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Deleting instance files /opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3_del
Nov 14 13:03:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Deletion of /opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3_del complete
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updated VIF entry in instance network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG nova.network.neutron [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": null, "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:03:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b8efcdfb-2a10-4af7-a9de-a5fbaac9b04d req-0f0a316a-5ebc-4ac0-a2ea-ea48788c304c service nova] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:03:42 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Deleted allocations for instance abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3
Nov 14 13:03:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'numa_topology' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:03:42 user nova-compute[75258]: DEBUG nova.objects.base [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Object Instance<abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3> lazy-loaded attributes: resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:03:42 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:03:42 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:03:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.185s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-6c5c8346-9575-471e-81aa-35ab41f40322 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 3.321s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:49 user nova-compute[75258]: INFO nova.compute.manager [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Terminating instance
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-05a766c0-cece-481f-b217-d0298fcde79a req-5bb7b8d5-2c87-4cf7-aefc-153ccb943af0 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-vif-unplugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-05a766c0-cece-481f-b217-d0298fcde79a req-5bb7b8d5-2c87-4cf7-aefc-153ccb943af0 service nova] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-05a766c0-cece-481f-b217-d0298fcde79a req-5bb7b8d5-2c87-4cf7-aefc-153ccb943af0 service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-05a766c0-cece-481f-b217-d0298fcde79a req-5bb7b8d5-2c87-4cf7-aefc-153ccb943af0 service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-05a766c0-cece-481f-b217-d0298fcde79a req-5bb7b8d5-2c87-4cf7-aefc-153ccb943af0 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] No waiting events found dispatching network-vif-unplugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-05a766c0-cece-481f-b217-d0298fcde79a req-5bb7b8d5-2c87-4cf7-aefc-153ccb943af0 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-vif-unplugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:03:49 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Instance destroyed successfully.
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.objects.instance [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lazy-loading 'resources' on Instance uuid ce45b26c-7df5-415f-9fbb-151f3684b6a9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:00:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-450070849',display_name='tempest-AttachVolumeNegativeTest-server-450070849',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-450070849',id=39,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9hsjklcK5NwB/2zHV4cK/8yeRXldhHXokx0fJwISdYStx8SXG5St/+tP86PtxlyW8Xmoh6XymHASsXnF80XkYQ2jrN6TctmIEYUGEL3c13L9t54X21+SebsZOBtO2oEQ==',key_name='tempest-keypair-1428488612',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:01:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c080a084f2b8483894a1904531d152ca',ramdisk_id='',reservation_id='r-8isqjlk6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-694932868',owner_user_name='tempest-AttachVolumeNegativeTest-694932868-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:01:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='0d957bc3f2cf4beb931c5796ce2a4c42',uuid=ce45b26c-7df5-415f-9fbb-151f3684b6a9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converting VIF {"id": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "address": "fa:16:3e:f3:6d:a1", "network": {"id": "ffc61a28-4572-482a-97ac-89bb52eb4e70", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-252738046-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.244", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c080a084f2b8483894a1904531d152ca", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef42907d-c9", "ovs_interfaceid": "ef42907d-c912-4956-afed-14d8c9a6fdc3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f3:6d:a1,bridge_name='br-int',has_traffic_filtering=True,id=ef42907d-c912-4956-afed-14d8c9a6fdc3,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef42907d-c9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG os_vif [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:6d:a1,bridge_name='br-int',has_traffic_filtering=True,id=ef42907d-c912-4956-afed-14d8c9a6fdc3,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef42907d-c9') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef42907d-c9, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e2b7f3e0-1cf9-4ada-9ad1-f406e9a47840) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:03:49 user nova-compute[75258]: INFO os_vif [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f3:6d:a1,bridge_name='br-int',has_traffic_filtering=True,id=ef42907d-c912-4956-afed-14d8c9a6fdc3,network=Network(ffc61a28-4572-482a-97ac-89bb52eb4e70),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef42907d-c9')
Nov 14 13:03:49 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Deleting instance files /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9_del
Nov 14 13:03:49 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Deletion of /opt/stack/data/nova/instances/ce45b26c-7df5-415f-9fbb-151f3684b6a9_del complete
Nov 14 13:03:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:49 user nova-compute[75258]: INFO nova.compute.manager [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 13:03:49 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:03:49 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:03:50 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:03:50 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Took 0.71 seconds to deallocate network for instance.
Nov 14 13:03:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:50 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:03:50 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:03:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.182s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:50 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Deleted allocations for instance ce45b26c-7df5-415f-9fbb-151f3684b6a9
Nov 14 13:03:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-1227667b-a644-43aa-936c-062a3d8e1b06 tempest-AttachVolumeNegativeTest-694932868 tempest-AttachVolumeNegativeTest-694932868-project-member] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.915s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-585d768c-01bf-4026-bff7-54dc896e713f req-f46a968e-0837-48a8-8ee8-5b449f0b6eb5 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-585d768c-01bf-4026-bff7-54dc896e713f req-f46a968e-0837-48a8-8ee8-5b449f0b6eb5 service nova] Acquiring lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:03:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-585d768c-01bf-4026-bff7-54dc896e713f req-f46a968e-0837-48a8-8ee8-5b449f0b6eb5 service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:03:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-585d768c-01bf-4026-bff7-54dc896e713f req-f46a968e-0837-48a8-8ee8-5b449f0b6eb5 service nova] Lock "ce45b26c-7df5-415f-9fbb-151f3684b6a9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:03:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-585d768c-01bf-4026-bff7-54dc896e713f req-f46a968e-0837-48a8-8ee8-5b449f0b6eb5 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] No waiting events found dispatching network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:03:51 user nova-compute[75258]: WARNING nova.compute.manager [req-585d768c-01bf-4026-bff7-54dc896e713f req-f46a968e-0837-48a8-8ee8-5b449f0b6eb5 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received unexpected event network-vif-plugged-ef42907d-c912-4956-afed-14d8c9a6fdc3 for instance with vm_state deleted and task_state None.
Nov 14 13:03:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-585d768c-01bf-4026-bff7-54dc896e713f req-f46a968e-0837-48a8-8ee8-5b449f0b6eb5 service nova] [instance: ce45b26c-7df5-415f-9fbb-151f3684b6a9] Received event network-vif-deleted-ef42907d-c912-4956-afed-14d8c9a6fdc3 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:03:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:03:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:04:06 user nova-compute[75258]: INFO nova.compute.manager [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Rescuing
Nov 14 13:04:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:04:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:04:06 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG nova.network.neutron [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-86194dce-c439-4fe1-86f3-699f1045d547 req-aeecd73d-c3a8-4331-917c-7906744bb6f1 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-unplugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-86194dce-c439-4fe1-86f3-699f1045d547 req-aeecd73d-c3a8-4331-917c-7906744bb6f1 service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-86194dce-c439-4fe1-86f3-699f1045d547 req-aeecd73d-c3a8-4331-917c-7906744bb6f1 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-86194dce-c439-4fe1-86f3-699f1045d547 req-aeecd73d-c3a8-4331-917c-7906744bb6f1 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-86194dce-c439-4fe1-86f3-699f1045d547 req-aeecd73d-c3a8-4331-917c-7906744bb6f1 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-unplugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:04:07 user nova-compute[75258]: WARNING nova.compute.manager [req-86194dce-c439-4fe1-86f3-699f1045d547 req-aeecd73d-c3a8-4331-917c-7906744bb6f1 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received unexpected event network-vif-unplugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with vm_state active and task_state rescuing.
Nov 14 13:04:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance destroyed successfully.
Nov 14 13:04:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Attempting rescue
Nov 14 13:04:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 13:04:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Creating image(s)
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'trusted_certs' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue" returned: 0 in 0.050s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.229s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'migration_context' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.base [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<2fb87e79-f7a8-4bfc-924f-cec1e3d45268> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Start _get_guest_xml network_info=[{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:e8:5c:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'resources' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.base [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<2fb87e79-f7a8-4bfc-924f-cec1e3d45268> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'numa_topology' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.base [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<2fb87e79-f7a8-4bfc-924f-cec1e3d45268> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:04:08 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:04:08 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'vcpu_model' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.base [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<2fb87e79-f7a8-4bfc-924f-cec1e3d45268> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2095679056',display_name='tempest-ServerRescueNegativeTestJSON-server-2095679056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2095679056',id=42,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:02:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-x3pfcjkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:02:24Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=2fb87e79-f7a8-4bfc-924f-cec1e3d45268,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:e8:5c:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:e8:5c:b8"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'pci_devices' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.objects.base [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<2fb87e79-f7a8-4bfc-924f-cec1e3d45268> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:04:08 user nova-compute[75258]:   <uuid>2fb87e79-f7a8-4bfc-924f-cec1e3d45268</uuid>
Nov 14 13:04:08 user nova-compute[75258]:   <name>instance-0000002a</name>
Nov 14 13:04:08 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:04:08 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:04:08 user nova-compute[75258]:   <metadata>
Nov 14 13:04:08 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:04:08 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:04:08 user nova-compute[75258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-2095679056</nova:name>
Nov 14 13:04:08 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:04:08</nova:creationTime>
Nov 14 13:04:08 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:04:08 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:04:08 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:04:08 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:04:08 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:04:08 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:04:08 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:04:08 user nova-compute[75258]:       <nova:owner>
Nov 14 13:04:08 user nova-compute[75258]:         <nova:user uuid="5106602814f6478fad50a7273995c8b9">tempest-ServerRescueNegativeTestJSON-607907589-project-member</nova:user>
Nov 14 13:04:08 user nova-compute[75258]:         <nova:project uuid="2b1b14d580c640bcbbd8ce084f5872a2">tempest-ServerRescueNegativeTestJSON-607907589</nova:project>
Nov 14 13:04:08 user nova-compute[75258]:       </nova:owner>
Nov 14 13:04:08 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:04:08 user nova-compute[75258]:       <nova:ports>
Nov 14 13:04:08 user nova-compute[75258]:         <nova:port uuid="26b28578-229d-4ad6-8ae4-d088ef0016f9">
Nov 14 13:04:08 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 13:04:08 user nova-compute[75258]:         </nova:port>
Nov 14 13:04:08 user nova-compute[75258]:       </nova:ports>
Nov 14 13:04:08 user nova-compute[75258]:     </nova:instance>
Nov 14 13:04:08 user nova-compute[75258]:   </metadata>
Nov 14 13:04:08 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:04:08 user nova-compute[75258]:     <system>
Nov 14 13:04:08 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:04:08 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:04:08 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:04:08 user nova-compute[75258]:       <entry name="serial">2fb87e79-f7a8-4bfc-924f-cec1e3d45268</entry>
Nov 14 13:04:08 user nova-compute[75258]:       <entry name="uuid">2fb87e79-f7a8-4bfc-924f-cec1e3d45268</entry>
Nov 14 13:04:08 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:04:08 user nova-compute[75258]:     </system>
Nov 14 13:04:08 user nova-compute[75258]:   </sysinfo>
Nov 14 13:04:08 user nova-compute[75258]:   <os>
Nov 14 13:04:08 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:04:08 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:04:08 user nova-compute[75258]:   </os>
Nov 14 13:04:08 user nova-compute[75258]:   <features>
Nov 14 13:04:08 user nova-compute[75258]:     <acpi/>
Nov 14 13:04:08 user nova-compute[75258]:     <apic/>
Nov 14 13:04:08 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:04:08 user nova-compute[75258]:   </features>
Nov 14 13:04:08 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:04:08 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:04:08 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:04:08 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:04:08 user nova-compute[75258]:   </clock>
Nov 14 13:04:08 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:04:08 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:04:08 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:04:08 user nova-compute[75258]:   </cpu>
Nov 14 13:04:08 user nova-compute[75258]:   <devices>
Nov 14 13:04:08 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:04:08 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:04:08 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue"/>
Nov 14 13:04:08 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:04:08 user nova-compute[75258]:     </disk>
Nov 14 13:04:08 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:04:08 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:04:08 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk"/>
Nov 14 13:04:08 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 13:04:08 user nova-compute[75258]:     </disk>
Nov 14 13:04:08 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:04:08 user nova-compute[75258]:       <mac address="fa:16:3e:e8:5c:b8"/>
Nov 14 13:04:08 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:04:08 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:04:08 user nova-compute[75258]:       <target dev="tap26b28578-22"/>
Nov 14 13:04:08 user nova-compute[75258]:     </interface>
Nov 14 13:04:08 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:04:08 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/console.log" append="off"/>
Nov 14 13:04:08 user nova-compute[75258]:     </serial>
Nov 14 13:04:08 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:04:08 user nova-compute[75258]:     <video>
Nov 14 13:04:08 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:04:08 user nova-compute[75258]:     </video>
Nov 14 13:04:08 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:04:08 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:04:08 user nova-compute[75258]:     </rng>
Nov 14 13:04:08 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:04:08 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:04:08 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:04:08 user nova-compute[75258]:     </memballoon>
Nov 14 13:04:08 user nova-compute[75258]:   </devices>
Nov 14 13:04:08 user nova-compute[75258]: </domain>
Nov 14 13:04:08 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:04:08 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance destroyed successfully.
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:04:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No VIF found with MAC fa:16:3e:e8:5c:b8, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-7ce90e5e-2f00-478d-9aac-643397eddba8 req-fccb48ef-5e66-41cd-85f2-575eb3699390 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7ce90e5e-2f00-478d-9aac-643397eddba8 req-fccb48ef-5e66-41cd-85f2-575eb3699390 service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7ce90e5e-2f00-478d-9aac-643397eddba8 req-fccb48ef-5e66-41cd-85f2-575eb3699390 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7ce90e5e-2f00-478d-9aac-643397eddba8 req-fccb48ef-5e66-41cd-85f2-575eb3699390 service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-7ce90e5e-2f00-478d-9aac-643397eddba8 req-fccb48ef-5e66-41cd-85f2-575eb3699390 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:04:09 user nova-compute[75258]: WARNING nova.compute.manager [req-7ce90e5e-2f00-478d-9aac-643397eddba8 req-fccb48ef-5e66-41cd-85f2-575eb3699390 service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received unexpected event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with vm_state active and task_state rescuing.
Nov 14 13:04:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:04:11 user nova-compute[75258]: WARNING nova.compute.manager [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received unexpected event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with vm_state active and task_state rescuing.
Nov 14 13:04:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:04:11 user nova-compute[75258]: WARNING nova.compute.manager [req-55673115-8f3a-4a38-97d5-cfb0b55875a8 req-39c56a88-2879-4b10-b9d6-c58ffd1dca1b service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received unexpected event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with vm_state active and task_state rescuing.
Nov 14 13:04:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-701d6d17-ebd0-4021-9db5-e4b6418840a9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:04:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:04:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Skipping network cache update for instance because it has been migrated to another host. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9966}}
Nov 14 13:04:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:04:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:04:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:04:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:04:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:04:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8713MB free_disk=25.106948852539062GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:04:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.285s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:04:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:04:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:04:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:05:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "36b749be-1d01-4829-afc8-efb7eaf05220" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "36b749be-1d01-4829-afc8-efb7eaf05220" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:05:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:09 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:05:09 user nova-compute[75258]: INFO nova.compute.claims [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Claim successful on node user
Nov 14 13:05:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.282s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:05:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.policy [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '15518ad8239e4e67ab46efcff0a068f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8c5d31bdbe6146749ab88abb71ef24a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:05:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Creating image(s)
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "/opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "/opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "/opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk 1073741824" returned: 0 in 0.066s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.261s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Successfully created port: c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Checking if we can resize image /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Cannot resize image /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Ensure instance console log exists: /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Successfully updated port: c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "refresh_cache-36b749be-1d01-4829-afc8-efb7eaf05220" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquired lock "refresh_cache-36b749be-1d01-4829-afc8-efb7eaf05220" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received event network-changed-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.compute.manager [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Refreshing instance network info cache due to event network-changed-c8bd9d0c-606b-4f78-9777-c6e532af28df. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] Acquiring lock "refresh_cache-36b749be-1d01-4829-afc8-efb7eaf05220" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Updating instance_info_cache with network_info: [{"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Releasing lock "refresh_cache-36b749be-1d01-4829-afc8-efb7eaf05220" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Instance network_info: |[{"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] Acquired lock "refresh_cache-36b749be-1d01-4829-afc8-efb7eaf05220" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.neutron [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Refreshing network info cache for port c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Start _get_guest_xml network_info=[{"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:05:11 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:05:11 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1916075706',display_name='tempest-VolumesActionsTest-instance-1916075706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1916075706',id=43,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c5d31bdbe6146749ab88abb71ef24a2',ramdisk_id='',reservation_id='r-5ek5fi05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-939597066',owner_user_name='tempest-VolumesActionsTest-939597066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:05:10Z,user_data=None,user_id='15518ad8239e4e67ab46efcff0a068f5',uuid=36b749be-1d01-4829-afc8-efb7eaf05220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Converting VIF {"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:81:dd,bridge_name='br-int',has_traffic_filtering=True,id=c8bd9d0c-606b-4f78-9777-c6e532af28df,network=Network(5e5e2ec9-28bf-4697-9828-a589ccd18987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bd9d0c-60') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lazy-loading 'pci_devices' on Instance uuid 36b749be-1d01-4829-afc8-efb7eaf05220 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:05:11 user nova-compute[75258]:   <uuid>36b749be-1d01-4829-afc8-efb7eaf05220</uuid>
Nov 14 13:05:11 user nova-compute[75258]:   <name>instance-0000002b</name>
Nov 14 13:05:11 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:05:11 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:05:11 user nova-compute[75258]:   <metadata>
Nov 14 13:05:11 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:05:11 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:05:11 user nova-compute[75258]:       <nova:name>tempest-VolumesActionsTest-instance-1916075706</nova:name>
Nov 14 13:05:11 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:05:11</nova:creationTime>
Nov 14 13:05:11 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:05:11 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:05:11 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:05:11 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:05:11 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:05:11 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:05:11 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:05:11 user nova-compute[75258]:       <nova:owner>
Nov 14 13:05:11 user nova-compute[75258]:         <nova:user uuid="15518ad8239e4e67ab46efcff0a068f5">tempest-VolumesActionsTest-939597066-project-member</nova:user>
Nov 14 13:05:11 user nova-compute[75258]:         <nova:project uuid="8c5d31bdbe6146749ab88abb71ef24a2">tempest-VolumesActionsTest-939597066</nova:project>
Nov 14 13:05:11 user nova-compute[75258]:       </nova:owner>
Nov 14 13:05:11 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:05:11 user nova-compute[75258]:       <nova:ports>
Nov 14 13:05:11 user nova-compute[75258]:         <nova:port uuid="c8bd9d0c-606b-4f78-9777-c6e532af28df">
Nov 14 13:05:11 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Nov 14 13:05:11 user nova-compute[75258]:         </nova:port>
Nov 14 13:05:11 user nova-compute[75258]:       </nova:ports>
Nov 14 13:05:11 user nova-compute[75258]:     </nova:instance>
Nov 14 13:05:11 user nova-compute[75258]:   </metadata>
Nov 14 13:05:11 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:05:11 user nova-compute[75258]:     <system>
Nov 14 13:05:11 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:05:11 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:05:11 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:05:11 user nova-compute[75258]:       <entry name="serial">36b749be-1d01-4829-afc8-efb7eaf05220</entry>
Nov 14 13:05:11 user nova-compute[75258]:       <entry name="uuid">36b749be-1d01-4829-afc8-efb7eaf05220</entry>
Nov 14 13:05:11 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:05:11 user nova-compute[75258]:     </system>
Nov 14 13:05:11 user nova-compute[75258]:   </sysinfo>
Nov 14 13:05:11 user nova-compute[75258]:   <os>
Nov 14 13:05:11 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:05:11 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:05:11 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:05:11 user nova-compute[75258]:   </os>
Nov 14 13:05:11 user nova-compute[75258]:   <features>
Nov 14 13:05:11 user nova-compute[75258]:     <acpi/>
Nov 14 13:05:11 user nova-compute[75258]:     <apic/>
Nov 14 13:05:11 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:05:11 user nova-compute[75258]:   </features>
Nov 14 13:05:11 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:05:11 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:05:11 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:05:11 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:05:11 user nova-compute[75258]:   </clock>
Nov 14 13:05:11 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:05:11 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:05:11 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:05:11 user nova-compute[75258]:   </cpu>
Nov 14 13:05:11 user nova-compute[75258]:   <devices>
Nov 14 13:05:11 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:05:11 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:05:11 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk"/>
Nov 14 13:05:11 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:05:11 user nova-compute[75258]:     </disk>
Nov 14 13:05:11 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:05:11 user nova-compute[75258]:       <mac address="fa:16:3e:5b:81:dd"/>
Nov 14 13:05:11 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:05:11 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:05:11 user nova-compute[75258]:       <target dev="tapc8bd9d0c-60"/>
Nov 14 13:05:11 user nova-compute[75258]:     </interface>
Nov 14 13:05:11 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:05:11 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/console.log" append="off"/>
Nov 14 13:05:11 user nova-compute[75258]:     </serial>
Nov 14 13:05:11 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:05:11 user nova-compute[75258]:     <video>
Nov 14 13:05:11 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:05:11 user nova-compute[75258]:     </video>
Nov 14 13:05:11 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:05:11 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:05:11 user nova-compute[75258]:     </rng>
Nov 14 13:05:11 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:05:11 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:05:11 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:05:11 user nova-compute[75258]:     </memballoon>
Nov 14 13:05:11 user nova-compute[75258]:   </devices>
Nov 14 13:05:11 user nova-compute[75258]: </domain>
Nov 14 13:05:11 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1916075706',display_name='tempest-VolumesActionsTest-instance-1916075706',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1916075706',id=43,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='8c5d31bdbe6146749ab88abb71ef24a2',ramdisk_id='',reservation_id='r-5ek5fi05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-939597066',owner_user_name='tempest-VolumesActionsTest-939597066-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:05:10Z,user_data=None,user_id='15518ad8239e4e67ab46efcff0a068f5',uuid=36b749be-1d01-4829-afc8-efb7eaf05220,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Converting VIF {"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:81:dd,bridge_name='br-int',has_traffic_filtering=True,id=c8bd9d0c-606b-4f78-9777-c6e532af28df,network=Network(5e5e2ec9-28bf-4697-9828-a589ccd18987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bd9d0c-60') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG os_vif [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:81:dd,bridge_name='br-int',has_traffic_filtering=True,id=c8bd9d0c-606b-4f78-9777-c6e532af28df,network=Network(5e5e2ec9-28bf-4697-9828-a589ccd18987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bd9d0c-60') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'b9fd7a2c-9340-53f8-8a90-fc50fbb38ae0', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc8bd9d0c-60, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc8bd9d0c-60, col_values=(('qos', UUID('59c08386-81fa-48d2-92e5-8035efae58ca')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc8bd9d0c-60, col_values=(('external_ids', {'iface-id': 'c8bd9d0c-606b-4f78-9777-c6e532af28df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:81:dd', 'vm-uuid': '36b749be-1d01-4829-afc8-efb7eaf05220'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:11 user nova-compute[75258]: INFO os_vif [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:81:dd,bridge_name='br-int',has_traffic_filtering=True,id=c8bd9d0c-606b-4f78-9777-c6e532af28df,network=Network(5e5e2ec9-28bf-4697-9828-a589ccd18987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bd9d0c-60')
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:05:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] No VIF found with MAC fa:16:3e:5b:81:dd, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:05:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Updated VIF entry in instance network info cache for port c8bd9d0c-606b-4f78-9777-c6e532af28df. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:05:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Updating instance_info_cache with network_info: [{"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:05:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5e618b2d-58c1-4043-921c-4278e2d6799a req-04f4228d-4adf-4cb8-8df7-daa642bfd2e8 service nova] Releasing lock "refresh_cache-36b749be-1d01-4829-afc8-efb7eaf05220" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-60501f60-ad35-4b48-831d-20d550fda7a0 req-9490578a-5268-4ff3-9616-26713ce83ec6 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received event network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-60501f60-ad35-4b48-831d-20d550fda7a0 req-9490578a-5268-4ff3-9616-26713ce83ec6 service nova] Acquiring lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-60501f60-ad35-4b48-831d-20d550fda7a0 req-9490578a-5268-4ff3-9616-26713ce83ec6 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-60501f60-ad35-4b48-831d-20d550fda7a0 req-9490578a-5268-4ff3-9616-26713ce83ec6 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-60501f60-ad35-4b48-831d-20d550fda7a0 req-9490578a-5268-4ff3-9616-26713ce83ec6 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] No waiting events found dispatching network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:05:13 user nova-compute[75258]: WARNING nova.compute.manager [req-60501f60-ad35-4b48-831d-20d550fda7a0 req-9490578a-5268-4ff3-9616-26713ce83ec6 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received unexpected event network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df for instance with vm_state building and task_state spawning.
Nov 14 13:05:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:05:15 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Instance spawned successfully.
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:05:15 user nova-compute[75258]: INFO nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-e54b83bc-2742-466a-aca1-6d0febf9e679 req-658bde75-fd05-417b-af86-41fe78a6dd74 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received event network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e54b83bc-2742-466a-aca1-6d0febf9e679 req-658bde75-fd05-417b-af86-41fe78a6dd74 service nova] Acquiring lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e54b83bc-2742-466a-aca1-6d0febf9e679 req-658bde75-fd05-417b-af86-41fe78a6dd74 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e54b83bc-2742-466a-aca1-6d0febf9e679 req-658bde75-fd05-417b-af86-41fe78a6dd74 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-e54b83bc-2742-466a-aca1-6d0febf9e679 req-658bde75-fd05-417b-af86-41fe78a6dd74 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] No waiting events found dispatching network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:05:15 user nova-compute[75258]: WARNING nova.compute.manager [req-e54b83bc-2742-466a-aca1-6d0febf9e679 req-658bde75-fd05-417b-af86-41fe78a6dd74 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received unexpected event network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df for instance with vm_state building and task_state spawning.
Nov 14 13:05:15 user nova-compute[75258]: INFO nova.compute.manager [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Took 5.63 seconds to build instance.
Nov 14 13:05:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-7dee5b3a-a1e5-4cf2-91c3-4adabd0f007d tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "36b749be-1d01-4829-afc8-efb7eaf05220" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.780s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updating instance_info_cache with network_info: [{"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-2bfe5292-6dc9-4b4d-980b-38e18cd593c9" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:05:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:05:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:30 user nova-compute[75258]: INFO nova.compute.manager [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Unshelving
Nov 14 13:05:30 user nova-compute[75258]: INFO nova.virt.block_device [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Booting with volume fb718c6a-0685-423b-9689-bae065ae7de1 at /dev/vda
Nov 14 13:05:30 user nova-compute[75258]: DEBUG os_brick.utils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:05:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2409fd6-d2fc-4c7c-8faf-c923edcbd1d9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[011fb2e9-50aa-4469-8cf7-7e3041c362c1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b384e637-c367-4911-88f2-162173501966]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce2d80-89c2-40f7-a45f-d90801e22fa1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:05:31 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:05:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9c59732-7e9f-4770-bbfd-31310f8df99a]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG os_brick.utils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating existing volume attachment record: 04acb23f-6bc5-4f49-ab71-2270355d1458 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:05:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'pci_requests' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'numa_topology' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:05:35 user nova-compute[75258]: INFO nova.compute.claims [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Claim successful on node user
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.445s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:35 user nova-compute[75258]: INFO nova.network.neutron [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating port a5d0ccce-a99a-45fd-a681-6678fe2be613 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing instance network info cache due to event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:05:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:05:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8556MB free_disk=25.07685089111328GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 36b749be-1d01-4829-afc8-efb7eaf05220 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance with task_state "spawning" is not being actively managed by this compute host but has allocations referencing this compute node (57b222fc-6379-46c4-a979-ca3142626f72): {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. Skipping heal of allocations during the task state transition. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1777}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:05:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.314s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.network.neutron [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:05:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Creating image(s)
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Ensure instance console log exists: /opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Start _get_guest_xml network_info=[{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3', 'attached_at': '', 'detached_at': '', 'volume_id': 'fb718c6a-0685-423b-9689-bae065ae7de1', 'serial': 'fb718c6a-0685-423b-9689-bae065ae7de1'}, 'device_type': 'disk', 'attachment_id': '04acb23f-6bc5-4f49-ab71-2270355d1458', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:05:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:05:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.objects.instance [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'vcpu_model' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.objects.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Object Instance<abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3> lazy-loaded attributes: pci_requests,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:05:37 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:05:37 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:05:37 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95fd56f7-1f9d-4dd2-860a-6040fc41a25c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:05:37 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c84f0001-9fa1-4d37-9388-bdcc27710657]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1] added
Nov 14 13:05:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e08c238-8306-4a4b-bd46-cf588de109d1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[50d60a8b-a4e6-46af-9e18-3d0b14bee5d8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afqdnRpv {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v afqdnRpv" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad753bf2-48f9-4e33-a47a-579a2bb385d6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'afqdnRpv'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddac19d8-de06-4a8c-a4b4-ea7ab33a1d8c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e1697f-5dd6-4243-8b3c-60cb488a24c3]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:05:37 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:05:37 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:05:37 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:05:37 user nova-compute[75258]: 
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f9640d-6f35-4e51-a90e-e756c050c21b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]
Nov 14 13:05:37 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.
Nov 14 13:05:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[42bb3467-ae34-4d23-9668-eb968c3121e1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9264703e-fe15-4ea4-9582-198438770347]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:05:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:05:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.262s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] HCTL ('33', '-', '-', 0) found on session 54 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d828a3b-6eec-4ec7-ae20-0f169da1c5b2]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Searching for a device in session 54 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updated VIF entry in instance network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:05:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-370f415b-454a-43eb-9322-076e8e0499f2 req-0bb19afc-4343-4a0d-9f2c-97fbeff0e8b5 service nova] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] <== connect_volume: return (1297ms) {'type': 'block', 'scsi_wwn': '23166323733376338', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166323733376338', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097283832',display_name='tempest-TestShelveInstance-server-2097283832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2097283832',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1373538128',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:01:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fdb669e737b040988bfb4be1d740f9f1',ramdisk_id='',reservation_id='r-l6b45rin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-803522430',owner_user_name='tempest-TestShelveInstance-803522430-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:05:31Z,user_data=None,user_id='5d3e776b6ec84a2bb1e7b70fc28ccb6e',uuid=abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converting VIF {"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'pci_devices' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.objects.base [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Object Instance<abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3> lazy-loaded attributes: pci_requests,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:05:38 user nova-compute[75258]:   <uuid>abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3</uuid>
Nov 14 13:05:38 user nova-compute[75258]:   <name>instance-00000028</name>
Nov 14 13:05:38 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:05:38 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:05:38 user nova-compute[75258]:   <metadata>
Nov 14 13:05:38 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:05:38 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:05:38 user nova-compute[75258]:       <nova:name>tempest-TestShelveInstance-server-2097283832</nova:name>
Nov 14 13:05:38 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:05:37</nova:creationTime>
Nov 14 13:05:38 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:05:38 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:05:38 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:05:38 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:05:38 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:05:38 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:05:38 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:05:38 user nova-compute[75258]:       <nova:owner>
Nov 14 13:05:38 user nova-compute[75258]:         <nova:user uuid="5d3e776b6ec84a2bb1e7b70fc28ccb6e">tempest-TestShelveInstance-803522430-project-member</nova:user>
Nov 14 13:05:38 user nova-compute[75258]:         <nova:project uuid="fdb669e737b040988bfb4be1d740f9f1">tempest-TestShelveInstance-803522430</nova:project>
Nov 14 13:05:38 user nova-compute[75258]:       </nova:owner>
Nov 14 13:05:38 user nova-compute[75258]:       <nova:ports>
Nov 14 13:05:38 user nova-compute[75258]:         <nova:port uuid="a5d0ccce-a99a-45fd-a681-6678fe2be613">
Nov 14 13:05:38 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Nov 14 13:05:38 user nova-compute[75258]:         </nova:port>
Nov 14 13:05:38 user nova-compute[75258]:       </nova:ports>
Nov 14 13:05:38 user nova-compute[75258]:     </nova:instance>
Nov 14 13:05:38 user nova-compute[75258]:   </metadata>
Nov 14 13:05:38 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:05:38 user nova-compute[75258]:     <system>
Nov 14 13:05:38 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:05:38 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:05:38 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:05:38 user nova-compute[75258]:       <entry name="serial">abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3</entry>
Nov 14 13:05:38 user nova-compute[75258]:       <entry name="uuid">abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3</entry>
Nov 14 13:05:38 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:05:38 user nova-compute[75258]:     </system>
Nov 14 13:05:38 user nova-compute[75258]:   </sysinfo>
Nov 14 13:05:38 user nova-compute[75258]:   <os>
Nov 14 13:05:38 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:05:38 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:05:38 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:05:38 user nova-compute[75258]:   </os>
Nov 14 13:05:38 user nova-compute[75258]:   <features>
Nov 14 13:05:38 user nova-compute[75258]:     <acpi/>
Nov 14 13:05:38 user nova-compute[75258]:     <apic/>
Nov 14 13:05:38 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:05:38 user nova-compute[75258]:   </features>
Nov 14 13:05:38 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:05:38 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:05:38 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:05:38 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:05:38 user nova-compute[75258]:   </clock>
Nov 14 13:05:38 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:05:38 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:05:38 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:05:38 user nova-compute[75258]:   </cpu>
Nov 14 13:05:38 user nova-compute[75258]:   <devices>
Nov 14 13:05:38 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:05:38 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:05:38 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 13:05:38 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:05:38 user nova-compute[75258]:       <serial>fb718c6a-0685-423b-9689-bae065ae7de1</serial>
Nov 14 13:05:38 user nova-compute[75258]:     </disk>
Nov 14 13:05:38 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:05:38 user nova-compute[75258]:       <mac address="fa:16:3e:01:51:45"/>
Nov 14 13:05:38 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:05:38 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:05:38 user nova-compute[75258]:       <target dev="tapa5d0ccce-a9"/>
Nov 14 13:05:38 user nova-compute[75258]:     </interface>
Nov 14 13:05:38 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:05:38 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3/console.log" append="off"/>
Nov 14 13:05:38 user nova-compute[75258]:     </serial>
Nov 14 13:05:38 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:05:38 user nova-compute[75258]:     <video>
Nov 14 13:05:38 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:05:38 user nova-compute[75258]:     </video>
Nov 14 13:05:38 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:05:38 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:05:38 user nova-compute[75258]:     </rng>
Nov 14 13:05:38 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:05:38 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:05:38 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:05:38 user nova-compute[75258]:     </memballoon>
Nov 14 13:05:38 user nova-compute[75258]:   </devices>
Nov 14 13:05:38 user nova-compute[75258]: </domain>
Nov 14 13:05:38 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097283832',display_name='tempest-TestShelveInstance-server-2097283832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2097283832',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-1373538128',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:01:56Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='fdb669e737b040988bfb4be1d740f9f1',ramdisk_id='',reservation_id='r-l6b45rin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-803522430',owner_user_name='tempest-TestShelveInstance-803522430-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:05:31Z,user_data=None,user_id='5d3e776b6ec84a2bb1e7b70fc28ccb6e',uuid=abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converting VIF {"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG os_vif [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '29181849-c834-5f1f-8193-14b925147556', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa5d0ccce-a9, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa5d0ccce-a9, col_values=(('qos', UUID('b5e6c70d-e18d-4fe0-961c-13fb4e6bb513')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa5d0ccce-a9, col_values=(('external_ids', {'iface-id': 'a5d0ccce-a99a-45fd-a681-6678fe2be613', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:01:51:45', 'vm-uuid': 'abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:38 user nova-compute[75258]: INFO os_vif [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9')
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:05:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] No VIF found with MAC fa:16:3e:01:51:45, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:05:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-c95d2d75-1d88-4202-a7c4-eb6d7562f1a2 req-837108b2-b33a-4ec2-9384-b5af916521bd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:05:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c95d2d75-1d88-4202-a7c4-eb6d7562f1a2 req-837108b2-b33a-4ec2-9384-b5af916521bd service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c95d2d75-1d88-4202-a7c4-eb6d7562f1a2 req-837108b2-b33a-4ec2-9384-b5af916521bd service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c95d2d75-1d88-4202-a7c4-eb6d7562f1a2 req-837108b2-b33a-4ec2-9384-b5af916521bd service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:40 user nova-compute[75258]: DEBUG nova.compute.manager [req-c95d2d75-1d88-4202-a7c4-eb6d7562f1a2 req-837108b2-b33a-4ec2-9384-b5af916521bd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:05:40 user nova-compute[75258]: WARNING nova.compute.manager [req-c95d2d75-1d88-4202-a7c4-eb6d7562f1a2 req-837108b2-b33a-4ec2-9384-b5af916521bd service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 13:05:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:05:42 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance spawned successfully.
Nov 14 13:05:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-af28e3a9-297b-4256-b099-c800f84dbf56 tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 11.283s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-b0b0057d-5b18-4c15-b919-475d2f623f8a req-96ab39ce-c9c7-49e0-8b8a-85eec3ddf7d8 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b0b0057d-5b18-4c15-b919-475d2f623f8a req-96ab39ce-c9c7-49e0-8b8a-85eec3ddf7d8 service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b0b0057d-5b18-4c15-b919-475d2f623f8a req-96ab39ce-c9c7-49e0-8b8a-85eec3ddf7d8 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b0b0057d-5b18-4c15-b919-475d2f623f8a req-96ab39ce-c9c7-49e0-8b8a-85eec3ddf7d8 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:05:42 user nova-compute[75258]: DEBUG nova.compute.manager [req-b0b0057d-5b18-4c15-b919-475d2f623f8a req-96ab39ce-c9c7-49e0-8b8a-85eec3ddf7d8 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:05:42 user nova-compute[75258]: WARNING nova.compute.manager [req-b0b0057d-5b18-4c15-b919-475d2f623f8a req-96ab39ce-c9c7-49e0-8b8a-85eec3ddf7d8 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state None.
Nov 14 13:05:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:05:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:06:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:06:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:06:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:06:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:06:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:06:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:06:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:06:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:06:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:06:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:06:30 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:06:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:06:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:06:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:06:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:06:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:35 user nova-compute[75258]: INFO nova.compute.manager [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Terminating instance
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.198s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-6294469d-9177-422b-82d4-4c1e5d0d66f5 req-eb4204c8-f733-40ba-a4c6-e7ea249330e9 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received event network-vif-unplugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6294469d-9177-422b-82d4-4c1e5d0d66f5 req-eb4204c8-f733-40ba-a4c6-e7ea249330e9 service nova] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6294469d-9177-422b-82d4-4c1e5d0d66f5 req-eb4204c8-f733-40ba-a4c6-e7ea249330e9 service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6294469d-9177-422b-82d4-4c1e5d0d66f5 req-eb4204c8-f733-40ba-a4c6-e7ea249330e9 service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-6294469d-9177-422b-82d4-4c1e5d0d66f5 req-eb4204c8-f733-40ba-a4c6-e7ea249330e9 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] No waiting events found dispatching network-vif-unplugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-6294469d-9177-422b-82d4-4c1e5d0d66f5 req-eb4204c8-f733-40ba-a4c6-e7ea249330e9 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received event network-vif-unplugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Instance destroyed successfully.
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lazy-loading 'resources' on Instance uuid 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T12:57:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-2031771365',display_name='tempest-ServersNegativeTestJSON-server-2031771365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-2031771365',id=37,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T12:57:59Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='25cb1c380db14d12848d79ba9982681c',ramdisk_id='',reservation_id='r-0tp44o7b',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-8951680',owner_user_name='tempest-ServersNegativeTestJSON-8951680-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T12:58:00Z,user_data=None,user_id='efce5644ae184c458b7fe8e3ef4c66da',uuid=2bfe5292-6dc9-4b4d-980b-38e18cd593c9,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converting VIF {"id": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "address": "fa:16:3e:f0:fb:d2", "network": {"id": "0cc9e07d-5305-49dc-bf02-17c873c955c2", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-1769361692-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "25cb1c380db14d12848d79ba9982681c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf799e0c5-98", "ovs_interfaceid": "f799e0c5-981a-4bea-a2a5-7d8fc204ad81", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f0:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf799e0c5-98') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG os_vif [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf799e0c5-98') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf799e0c5-98, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b4242fa3-4e7f-42a3-bf5f-b26137153d38) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:06:35 user nova-compute[75258]: INFO os_vif [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f0:fb:d2,bridge_name='br-int',has_traffic_filtering=True,id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81,network=Network(0cc9e07d-5305-49dc-bf02-17c873c955c2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf799e0c5-98')
Nov 14 13:06:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Deleting instance files /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9_del
Nov 14 13:06:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Deletion of /opt/stack/data/nova/instances/2bfe5292-6dc9-4b4d-980b-38e18cd593c9_del complete
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:35 user nova-compute[75258]: INFO nova.compute.manager [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Took 0.93 seconds to destroy the instance on the hypervisor.
Nov 14 13:06:35 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:06:35 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-ba213d44-5f76-4c85-9bc3-dd31e4655520 req-a15b271d-1b7a-46d5-b1eb-837ec9b66a70 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received event network-vif-deleted-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:06:36 user nova-compute[75258]: INFO nova.compute.manager [req-ba213d44-5f76-4c85-9bc3-dd31e4655520 req-a15b271d-1b7a-46d5-b1eb-837ec9b66a70 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Neutron deleted interface f799e0c5-981a-4bea-a2a5-7d8fc204ad81; detaching it from the instance and deleting it from the info cache
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-ba213d44-5f76-4c85-9bc3-dd31e4655520 req-a15b271d-1b7a-46d5-b1eb-837ec9b66a70 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:06:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:06:36 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8495MB free_disk=25.07370376586914GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:36 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Took 0.88 seconds to deallocate network for instance.
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-ba213d44-5f76-4c85-9bc3-dd31e4655520 req-a15b271d-1b7a-46d5-b1eb-837ec9b66a70 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Detach interface failed, port_id=f799e0c5-981a-4bea-a2a5-7d8fc204ad81, reason: Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 36b749be-1d01-4829-afc8-efb7eaf05220 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:06:36 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.342s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.259s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-6bfd43a3-ddc5-42e1-9138-21642db0110c req-2f1a2ec3-e94e-49d3-9eee-0ef19dbfc6e6 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received event network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6bfd43a3-ddc5-42e1-9138-21642db0110c req-2f1a2ec3-e94e-49d3-9eee-0ef19dbfc6e6 service nova] Acquiring lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6bfd43a3-ddc5-42e1-9138-21642db0110c req-2f1a2ec3-e94e-49d3-9eee-0ef19dbfc6e6 service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6bfd43a3-ddc5-42e1-9138-21642db0110c req-2f1a2ec3-e94e-49d3-9eee-0ef19dbfc6e6 service nova] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-6bfd43a3-ddc5-42e1-9138-21642db0110c req-2f1a2ec3-e94e-49d3-9eee-0ef19dbfc6e6 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] No waiting events found dispatching network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:06:37 user nova-compute[75258]: WARNING nova.compute.manager [req-6bfd43a3-ddc5-42e1-9138-21642db0110c req-2f1a2ec3-e94e-49d3-9eee-0ef19dbfc6e6 service nova] [instance: 2bfe5292-6dc9-4b4d-980b-38e18cd593c9] Received unexpected event network-vif-plugged-f799e0c5-981a-4bea-a2a5-7d8fc204ad81 for instance with vm_state deleted and task_state None.
Nov 14 13:06:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.259s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:37 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Deleted allocations for instance 2bfe5292-6dc9-4b4d-980b-38e18cd593c9
Nov 14 13:06:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b35e47cf-159b-4592-9752-d9892e2269d2 tempest-ServersNegativeTestJSON-8951680 tempest-ServersNegativeTestJSON-8951680-project-member] Lock "2bfe5292-6dc9-4b4d-980b-38e18cd593c9" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.534s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:06:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:06:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:06:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:59 user nova-compute[75258]: INFO nova.compute.manager [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Rescuing
Nov 14 13:06:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-31f72847-daeb-4190-be3e-aca3a8f43560 req-f239a7ac-a5c4-4353-941d-6706049a1252 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-31f72847-daeb-4190-be3e-aca3a8f43560 req-f239a7ac-a5c4-4353-941d-6706049a1252 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-31f72847-daeb-4190-be3e-aca3a8f43560 req-f239a7ac-a5c4-4353-941d-6706049a1252 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-31f72847-daeb-4190-be3e-aca3a8f43560 req-f239a7ac-a5c4-4353-941d-6706049a1252 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:06:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-31f72847-daeb-4190-be3e-aca3a8f43560 req-f239a7ac-a5c4-4353-941d-6706049a1252 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:06:59 user nova-compute[75258]: WARNING nova.compute.manager [req-31f72847-daeb-4190-be3e-aca3a8f43560 req-f239a7ac-a5c4-4353-941d-6706049a1252 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state active and task_state rescuing.
Nov 14 13:07:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:00 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance destroyed successfully.
Nov 14 13:07:00 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Attempting rescue
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 13:07:00 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Creating image(s)
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'trusted_certs' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue" returned: 0 in 0.052s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.232s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'migration_context' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.base [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<6f4e59bf-246f-4490-8c6a-71b39185fc17> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Start _get_guest_xml network_info=[{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:e0:e9:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'resources' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.base [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<6f4e59bf-246f-4490-8c6a-71b39185fc17> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'numa_topology' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.base [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<6f4e59bf-246f-4490-8c6a-71b39185fc17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:07:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:07:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'vcpu_model' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.base [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<6f4e59bf-246f-4490-8c6a-71b39185fc17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494633960',display_name='tempest-ServerRescueNegativeTestJSON-server-494633960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494633960',id=41,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:02:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-fh3gql35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:02:24Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=6f4e59bf-246f-4490-8c6a-71b39185fc17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:e0:e9:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:e0:e9:74"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.instance [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'pci_devices' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.objects.base [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<6f4e59bf-246f-4490-8c6a-71b39185fc17> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:07:00 user nova-compute[75258]:   <uuid>6f4e59bf-246f-4490-8c6a-71b39185fc17</uuid>
Nov 14 13:07:00 user nova-compute[75258]:   <name>instance-00000029</name>
Nov 14 13:07:00 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:07:00 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:07:00 user nova-compute[75258]:   <metadata>
Nov 14 13:07:00 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:07:00 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:07:00 user nova-compute[75258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-494633960</nova:name>
Nov 14 13:07:00 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:07:00</nova:creationTime>
Nov 14 13:07:00 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:07:00 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:07:00 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:07:00 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:07:00 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:07:00 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:07:00 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:07:00 user nova-compute[75258]:       <nova:owner>
Nov 14 13:07:00 user nova-compute[75258]:         <nova:user uuid="5106602814f6478fad50a7273995c8b9">tempest-ServerRescueNegativeTestJSON-607907589-project-member</nova:user>
Nov 14 13:07:00 user nova-compute[75258]:         <nova:project uuid="2b1b14d580c640bcbbd8ce084f5872a2">tempest-ServerRescueNegativeTestJSON-607907589</nova:project>
Nov 14 13:07:00 user nova-compute[75258]:       </nova:owner>
Nov 14 13:07:00 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:07:00 user nova-compute[75258]:       <nova:ports>
Nov 14 13:07:00 user nova-compute[75258]:         <nova:port uuid="73ccdfd9-b72c-4945-ac09-05a199745af0">
Nov 14 13:07:00 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 13:07:00 user nova-compute[75258]:         </nova:port>
Nov 14 13:07:00 user nova-compute[75258]:       </nova:ports>
Nov 14 13:07:00 user nova-compute[75258]:     </nova:instance>
Nov 14 13:07:00 user nova-compute[75258]:   </metadata>
Nov 14 13:07:00 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:07:00 user nova-compute[75258]:     <system>
Nov 14 13:07:00 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:07:00 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:07:00 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:07:00 user nova-compute[75258]:       <entry name="serial">6f4e59bf-246f-4490-8c6a-71b39185fc17</entry>
Nov 14 13:07:00 user nova-compute[75258]:       <entry name="uuid">6f4e59bf-246f-4490-8c6a-71b39185fc17</entry>
Nov 14 13:07:00 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:07:00 user nova-compute[75258]:     </system>
Nov 14 13:07:00 user nova-compute[75258]:   </sysinfo>
Nov 14 13:07:00 user nova-compute[75258]:   <os>
Nov 14 13:07:00 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:07:00 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:07:00 user nova-compute[75258]:   </os>
Nov 14 13:07:00 user nova-compute[75258]:   <features>
Nov 14 13:07:00 user nova-compute[75258]:     <acpi/>
Nov 14 13:07:00 user nova-compute[75258]:     <apic/>
Nov 14 13:07:00 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:07:00 user nova-compute[75258]:   </features>
Nov 14 13:07:00 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:07:00 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:07:00 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:07:00 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:07:00 user nova-compute[75258]:   </clock>
Nov 14 13:07:00 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:07:00 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:07:00 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:07:00 user nova-compute[75258]:   </cpu>
Nov 14 13:07:00 user nova-compute[75258]:   <devices>
Nov 14 13:07:00 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:07:00 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:07:00 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue"/>
Nov 14 13:07:00 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:07:00 user nova-compute[75258]:     </disk>
Nov 14 13:07:00 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:07:00 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:07:00 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk"/>
Nov 14 13:07:00 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 13:07:00 user nova-compute[75258]:     </disk>
Nov 14 13:07:00 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:07:00 user nova-compute[75258]:       <mac address="fa:16:3e:e0:e9:74"/>
Nov 14 13:07:00 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:07:00 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:07:00 user nova-compute[75258]:       <target dev="tap73ccdfd9-b7"/>
Nov 14 13:07:00 user nova-compute[75258]:     </interface>
Nov 14 13:07:00 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:07:00 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/console.log" append="off"/>
Nov 14 13:07:00 user nova-compute[75258]:     </serial>
Nov 14 13:07:00 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:07:00 user nova-compute[75258]:     <video>
Nov 14 13:07:00 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:07:00 user nova-compute[75258]:     </video>
Nov 14 13:07:00 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:07:00 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:07:00 user nova-compute[75258]:     </rng>
Nov 14 13:07:00 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:07:00 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:07:00 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:07:00 user nova-compute[75258]:     </memballoon>
Nov 14 13:07:00 user nova-compute[75258]:   </devices>
Nov 14 13:07:00 user nova-compute[75258]: </domain>
Nov 14 13:07:00 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:07:00 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance destroyed successfully.
Nov 14 13:07:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:07:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No VIF found with MAC fa:16:3e:e0:e9:74, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:07:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-347a71aa-da25-4455-9324-dcf27680853b req-f3619899-73b4-4def-87be-39bcb39097c1 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-347a71aa-da25-4455-9324-dcf27680853b req-f3619899-73b4-4def-87be-39bcb39097c1 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-347a71aa-da25-4455-9324-dcf27680853b req-f3619899-73b4-4def-87be-39bcb39097c1 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-347a71aa-da25-4455-9324-dcf27680853b req-f3619899-73b4-4def-87be-39bcb39097c1 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-347a71aa-da25-4455-9324-dcf27680853b req-f3619899-73b4-4def-87be-39bcb39097c1 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:07:02 user nova-compute[75258]: WARNING nova.compute.manager [req-347a71aa-da25-4455-9324-dcf27680853b req-f3619899-73b4-4def-87be-39bcb39097c1 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state active and task_state rescuing.
Nov 14 13:07:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:07:04 user nova-compute[75258]: WARNING nova.compute.manager [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state active and task_state rescuing.
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:07:04 user nova-compute[75258]: WARNING nova.compute.manager [req-8437a945-5192-4119-8c59-318600663785 req-6b449801-1835-45f4-b713-2edf7c01d90a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state active and task_state rescuing.
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-aca0888d-f786-4b68-b0a7-7b1b730dd432 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "36b749be-1d01-4829-afc8-efb7eaf05220" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "36b749be-1d01-4829-afc8-efb7eaf05220" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:04 user nova-compute[75258]: INFO nova.compute.manager [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Terminating instance
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-4e073c41-bf37-4c81-97f9-60b0cf092af5 req-dba415f6-9967-46b2-82c9-8d4042605017 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received event network-vif-unplugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4e073c41-bf37-4c81-97f9-60b0cf092af5 req-dba415f6-9967-46b2-82c9-8d4042605017 service nova] Acquiring lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4e073c41-bf37-4c81-97f9-60b0cf092af5 req-dba415f6-9967-46b2-82c9-8d4042605017 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4e073c41-bf37-4c81-97f9-60b0cf092af5 req-dba415f6-9967-46b2-82c9-8d4042605017 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-4e073c41-bf37-4c81-97f9-60b0cf092af5 req-dba415f6-9967-46b2-82c9-8d4042605017 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] No waiting events found dispatching network-vif-unplugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:07:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-4e073c41-bf37-4c81-97f9-60b0cf092af5 req-dba415f6-9967-46b2-82c9-8d4042605017 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received event network-vif-unplugged-c8bd9d0c-606b-4f78-9777-c6e532af28df for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Instance destroyed successfully.
Nov 14 13:07:05 user nova-compute[75258]: DEBUG nova.objects.instance [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lazy-loading 'resources' on Instance uuid 36b749be-1d01-4829-afc8-efb7eaf05220 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:05:09Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1916075706',display_name='tempest-VolumesActionsTest-instance-1916075706',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1916075706',id=43,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:05:15Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='8c5d31bdbe6146749ab88abb71ef24a2',ramdisk_id='',reservation_id='r-5ek5fi05',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-939597066',owner_user_name='tempest-VolumesActionsTest-939597066-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:05:15Z,user_data=None,user_id='15518ad8239e4e67ab46efcff0a068f5',uuid=36b749be-1d01-4829-afc8-efb7eaf05220,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Converting VIF {"id": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "address": "fa:16:3e:5b:81:dd", "network": {"id": "5e5e2ec9-28bf-4697-9828-a589ccd18987", "bridge": "br-int", "label": "tempest-VolumesActionsTest-120109123-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "8c5d31bdbe6146749ab88abb71ef24a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc8bd9d0c-60", "ovs_interfaceid": "c8bd9d0c-606b-4f78-9777-c6e532af28df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:81:dd,bridge_name='br-int',has_traffic_filtering=True,id=c8bd9d0c-606b-4f78-9777-c6e532af28df,network=Network(5e5e2ec9-28bf-4697-9828-a589ccd18987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bd9d0c-60') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG os_vif [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:81:dd,bridge_name='br-int',has_traffic_filtering=True,id=c8bd9d0c-606b-4f78-9777-c6e532af28df,network=Network(5e5e2ec9-28bf-4697-9828-a589ccd18987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bd9d0c-60') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc8bd9d0c-60, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=59c08386-81fa-48d2-92e5-8035efae58ca) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:05 user nova-compute[75258]: INFO os_vif [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:81:dd,bridge_name='br-int',has_traffic_filtering=True,id=c8bd9d0c-606b-4f78-9777-c6e532af28df,network=Network(5e5e2ec9-28bf-4697-9828-a589ccd18987),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc8bd9d0c-60')
Nov 14 13:07:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Deleting instance files /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220_del
Nov 14 13:07:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Deletion of /opt/stack/data/nova/instances/36b749be-1d01-4829-afc8-efb7eaf05220_del complete
Nov 14 13:07:05 user nova-compute[75258]: INFO nova.compute.manager [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Took 0.94 seconds to destroy the instance on the hypervisor.
Nov 14 13:07:05 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:07:05 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:07:06 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Took 0.40 seconds to deallocate network for instance.
Nov 14 13:07:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-dcee2a5e-7628-4245-b10f-cba94001afc0 req-8205ef7f-ecea-4862-84ce-23e4b9a31f6c service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received event network-vif-deleted-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.207s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:06 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Deleted allocations for instance 36b749be-1d01-4829-afc8-efb7eaf05220
Nov 14 13:07:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-02b91697-076c-46bc-98be-b23384e87913 tempest-VolumesActionsTest-939597066 tempest-VolumesActionsTest-939597066-project-member] Lock "36b749be-1d01-4829-afc8-efb7eaf05220" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.724s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-386a04e4-d714-4f14-bc2b-ef3fd42abd6c req-ee4ced8f-9826-40da-b411-75683293d1d5 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received event network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-386a04e4-d714-4f14-bc2b-ef3fd42abd6c req-ee4ced8f-9826-40da-b411-75683293d1d5 service nova] Acquiring lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-386a04e4-d714-4f14-bc2b-ef3fd42abd6c req-ee4ced8f-9826-40da-b411-75683293d1d5 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-386a04e4-d714-4f14-bc2b-ef3fd42abd6c req-ee4ced8f-9826-40da-b411-75683293d1d5 service nova] Lock "36b749be-1d01-4829-afc8-efb7eaf05220-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-386a04e4-d714-4f14-bc2b-ef3fd42abd6c req-ee4ced8f-9826-40da-b411-75683293d1d5 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] No waiting events found dispatching network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:07:06 user nova-compute[75258]: WARNING nova.compute.manager [req-386a04e4-d714-4f14-bc2b-ef3fd42abd6c req-ee4ced8f-9826-40da-b411-75683293d1d5 service nova] [instance: 36b749be-1d01-4829-afc8-efb7eaf05220] Received unexpected event network-vif-plugged-c8bd9d0c-606b-4f78-9777-c6e532af28df for instance with vm_state deleted and task_state None.
Nov 14 13:07:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:07:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:07:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:07:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG nova.compute.manager [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing instance network info cache due to event network-changed-a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] Acquiring lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] Acquired lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG nova.network.neutron [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Refreshing network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:21 user nova-compute[75258]: INFO nova.compute.manager [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Terminating instance
Nov 14 13:07:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updated VIF entry in instance network info cache for port a5d0ccce-a99a-45fd-a681-6678fe2be613. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.network.neutron [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [{"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f5ba123c-f208-47ac-a996-0474bb2fa2c9 req-f9a3293b-8d3b-44c0-9493-962fafaaa362 service nova] Releasing lock "refresh_cache-abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:07:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Instance destroyed successfully.
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.objects.instance [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lazy-loading 'resources' on Instance uuid abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:01:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2097283832',display_name='tempest-TestShelveInstance-server-2097283832',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2097283832',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJI+9X2TV9rdUZKl4RBR8c8B50/XUrW11gncjFra8lGpCL05B0NDLWa04nMF4GQ05xUxhgWWyZvjJPxXZIiqcPB/4Z4nWJRPUKxSPKqO0/dnHEoSQvDDOKkfDkRwfgRrBg==',key_name='tempest-TestShelveInstance-1373538128',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:05:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='fdb669e737b040988bfb4be1d740f9f1',ramdisk_id='',reservation_id='r-l6b45rin',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-803522430',owner_user_name='tempest-TestShelveInstance-803522430-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:05:42Z,user_data=None,user_id='5d3e776b6ec84a2bb1e7b70fc28ccb6e',uuid=abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converting VIF {"id": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "address": "fa:16:3e:01:51:45", "network": {"id": "8e85768e-a517-421a-91ce-ed62a8b8b4b2", "bridge": "br-int", "label": "tempest-TestShelveInstance-510810916-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.63", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "fdb669e737b040988bfb4be1d740f9f1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa5d0ccce-a9", "ovs_interfaceid": "a5d0ccce-a99a-45fd-a681-6678fe2be613", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_vif [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa5d0ccce-a9, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b5e6c70d-e18d-4fe0-961c-13fb4e6bb513) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:22 user nova-compute[75258]: INFO os_vif [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:01:51:45,bridge_name='br-int',has_traffic_filtering=True,id=a5d0ccce-a99a-45fd-a681-6678fe2be613,network=Network(8e85768e-a517-421a-91ce-ed62a8b8b4b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa5d0ccce-a9')
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'afqdnRpv', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:07:22 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[397fbab1-ff12-42d2-93e2-b8c69dede64d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:07:22 user nova-compute[75258]: No targets found.
Nov 14 13:07:22 user nova-compute[75258]: iSNS:
Nov 14 13:07:22 user nova-compute[75258]: No targets found.
Nov 14 13:07:22 user nova-compute[75258]: STATIC:
Nov 14 13:07:22 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1
Nov 14 13:07:22 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:07:22 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:07:22 user nova-compute[75258]: FIRMWARE:
Nov 14 13:07:22 user nova-compute[75258]: No targets found.
Nov 14 13:07:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:07:22 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:07:22 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a796366-c612-463c-a876-2cf91070fa30]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[872e0a33-c55f-4e0e-a831-3d3deb747d9e]: (4, ('tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:07:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsi session list stdout=tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 (non-flash)
Nov 14 13:07:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b40820e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc22f52-90af-44b3-9838-0c734e2721fd]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34ee984-1910-4414-a164-7a4cdea6b5d9]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1972e-2782-4245-9eb7-36161781fa0d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[966f09c3-6dd4-41ec-9877-44e35d0495e4]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5596a79-ba27-416e-805d-8e4275753772]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f309b6c-2799-4de9-8376-944b0cec9676]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260]
Nov 14 13:07:22 user nova-compute[75258]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1, portal: 172.16.0.220,3260] successful.
Nov 14 13:07:22 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fb718c6a-0685-423b-9689-bae065ae7de1 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20dd6372-f936-421e-8df4-47594b970fae]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] <== disconnect_volume: return (308ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:07:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Deleting instance files /opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3_del
Nov 14 13:07:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Deletion of /opt/stack/data/nova/instances/abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3_del complete
Nov 14 13:07:22 user nova-compute[75258]: INFO nova.compute.manager [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Took 1.20 seconds to destroy the instance on the hypervisor.
Nov 14 13:07:22 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:07:22 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:07:23 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Took 0.42 seconds to deallocate network for instance.
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-08b6afd7-59fe-4180-8fd4-2db51019b91d req-ae25cf55-5590-45f8-8a6b-415b5e68a18e service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-deleted-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:23 user nova-compute[75258]: INFO nova.compute.manager [req-08b6afd7-59fe-4180-8fd4-2db51019b91d req-ae25cf55-5590-45f8-8a6b-415b5e68a18e service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Neutron deleted interface a5d0ccce-a99a-45fd-a681-6678fe2be613; detaching it from the instance and deleting it from the info cache
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.network.neutron [req-08b6afd7-59fe-4180-8fd4-2db51019b91d req-ae25cf55-5590-45f8-8a6b-415b5e68a18e service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-08b6afd7-59fe-4180-8fd4-2db51019b91d req-ae25cf55-5590-45f8-8a6b-415b5e68a18e service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Detach interface failed, port_id=a5d0ccce-a99a-45fd-a681-6678fe2be613, reason: Instance abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-unplugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] Acquiring lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] No waiting events found dispatching network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:07:23 user nova-compute[75258]: WARNING nova.compute.manager [req-bd646e05-f6be-469d-8c40-c9058626be0f req-54e0754c-2d19-47b5-abf2-09b384baff06 service nova] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Received unexpected event network-vif-plugged-a5d0ccce-a99a-45fd-a681-6678fe2be613 for instance with vm_state active and task_state deleting.
Nov 14 13:07:24 user nova-compute[75258]: INFO nova.compute.manager [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Took 0.81 seconds to detach 1 volumes for instance.
Nov 14 13:07:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] [instance: abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3] Deleting volume: fb718c6a-0685-423b-9689-bae065ae7de1 {{(pid=75258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 13:07:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:24 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:07:24 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:07:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.173s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:24 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Deleted allocations for instance abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3
Nov 14 13:07:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-e54b7ebd-80b5-4eeb-9d5d-8352588b5a7e tempest-TestShelveInstance-803522430 tempest-TestShelveInstance-803522430-project-member] Lock "abfea0c2-50dd-44a7-a4cf-56e6cec0dbf3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.959s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:07:30 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:07:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:07:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:07:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:07:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8807MB free_disk=25.11092758178711GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:07:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.233s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:07:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:07:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:07:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:07:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:07:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:07:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:07:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:08:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk.rescue --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:08:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:08:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:08:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=25.099365234375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:08:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.456s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:08:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:08:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:50 user nova-compute[75258]: INFO nova.compute.manager [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Unrescuing
Nov 14 13:08:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:08:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:08:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:08:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:08:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:08:50 user nova-compute[75258]: DEBUG nova.objects.instance [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'flavor' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:08:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-b0691e06-0d72-42e6-bcb8-826609080360 req-4f735011-2cd3-456c-9e9e-1be1a0c74ce1 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b0691e06-0d72-42e6-bcb8-826609080360 req-4f735011-2cd3-456c-9e9e-1be1a0c74ce1 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b0691e06-0d72-42e6-bcb8-826609080360 req-4f735011-2cd3-456c-9e9e-1be1a0c74ce1 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b0691e06-0d72-42e6-bcb8-826609080360 req-4f735011-2cd3-456c-9e9e-1be1a0c74ce1 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-b0691e06-0d72-42e6-bcb8-826609080360 req-4f735011-2cd3-456c-9e9e-1be1a0c74ce1 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:51 user nova-compute[75258]: WARNING nova.compute.manager [req-b0691e06-0d72-42e6-bcb8-826609080360 req-4f735011-2cd3-456c-9e9e-1be1a0c74ce1 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance destroyed successfully.
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:53 user nova-compute[75258]: WARNING nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:53 user nova-compute[75258]: WARNING nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:53 user nova-compute[75258]: WARNING nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:53 user nova-compute[75258]: WARNING nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:53 user nova-compute[75258]: WARNING nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:53 user nova-compute[75258]: WARNING nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:08:53 user nova-compute[75258]: DEBUG nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:08:53 user nova-compute[75258]: WARNING nova.compute.manager [req-baa07301-50c9-455a-9dec-c2ae867f4b78 req-92440422-ccb4-4d64-8435-b9c076c1a980 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:08:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-424788f9-73be-4b0e-b133-16ba5286d2cf tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:08:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:08:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:09:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:09:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:09:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:09:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:09:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:09:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:09:35 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:09:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:09:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:09:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:09:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:09:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:09:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:09:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:09:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:09:37 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8986MB free_disk=25.0970458984375GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.260s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:09:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:09:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:09:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:09:43 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:09:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:09:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:09:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:09:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:09:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:09:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:09:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:09:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:09:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:09:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:10:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:10:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:10:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:10:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:10:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:39 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:10:39 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9028MB free_disk=25.09648895263672GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.006s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:10:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.226s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:41 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:10:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:10:45 user nova-compute[75258]: INFO nova.compute.claims [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Claim successful on node user
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:10:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.policy [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '5106602814f6478fad50a7273995c8b9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b1b14d580c640bcbbd8ce084f5872a2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:10:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Creating image(s)
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk 1073741824" returned: 0 in 0.051s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Successfully created port: e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.187s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Checking if we can resize image /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Cannot resize image /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Ensure instance console log exists: /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Successfully updated port: e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing instance network info cache due to event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance network_info: |[{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Start _get_guest_xml network_info=[{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:10:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:10:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-867286604',display_name='tempest-ServerRescueNegativeTestJSON-server-867286604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-867286604',id=44,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM23RcspOGpf6mxrhVn91aprJVcDVarX36t7E4xlXnpXOnU2OlE317MwVsytw4xFMNUSJuOR5Wo3DTbBHXNHQ53eOwYdQZAFipd5Jv4WQvJxa6S6AdqkNasy+Tp1ob57gA==',key_name='tempest-keypair-1585408966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-seiugfrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5106602814f6478fad50a7273995c8b9',uuid=44c12330-6c43-4e2a-a3ae-ea1542c76a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'pci_devices' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:10:47 user nova-compute[75258]:   <uuid>44c12330-6c43-4e2a-a3ae-ea1542c76a63</uuid>
Nov 14 13:10:47 user nova-compute[75258]:   <name>instance-0000002c</name>
Nov 14 13:10:47 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:10:47 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:10:47 user nova-compute[75258]:   <metadata>
Nov 14 13:10:47 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:10:47 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:10:47 user nova-compute[75258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-867286604</nova:name>
Nov 14 13:10:47 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:10:47</nova:creationTime>
Nov 14 13:10:47 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:10:47 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:10:47 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:10:47 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:10:47 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:10:47 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:10:47 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:10:47 user nova-compute[75258]:       <nova:owner>
Nov 14 13:10:47 user nova-compute[75258]:         <nova:user uuid="5106602814f6478fad50a7273995c8b9">tempest-ServerRescueNegativeTestJSON-607907589-project-member</nova:user>
Nov 14 13:10:47 user nova-compute[75258]:         <nova:project uuid="2b1b14d580c640bcbbd8ce084f5872a2">tempest-ServerRescueNegativeTestJSON-607907589</nova:project>
Nov 14 13:10:47 user nova-compute[75258]:       </nova:owner>
Nov 14 13:10:47 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:10:47 user nova-compute[75258]:       <nova:ports>
Nov 14 13:10:47 user nova-compute[75258]:         <nova:port uuid="e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc">
Nov 14 13:10:47 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 13:10:47 user nova-compute[75258]:         </nova:port>
Nov 14 13:10:47 user nova-compute[75258]:       </nova:ports>
Nov 14 13:10:47 user nova-compute[75258]:     </nova:instance>
Nov 14 13:10:47 user nova-compute[75258]:   </metadata>
Nov 14 13:10:47 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:10:47 user nova-compute[75258]:     <system>
Nov 14 13:10:47 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:10:47 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:10:47 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:10:47 user nova-compute[75258]:       <entry name="serial">44c12330-6c43-4e2a-a3ae-ea1542c76a63</entry>
Nov 14 13:10:47 user nova-compute[75258]:       <entry name="uuid">44c12330-6c43-4e2a-a3ae-ea1542c76a63</entry>
Nov 14 13:10:47 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:10:47 user nova-compute[75258]:     </system>
Nov 14 13:10:47 user nova-compute[75258]:   </sysinfo>
Nov 14 13:10:47 user nova-compute[75258]:   <os>
Nov 14 13:10:47 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:10:47 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:10:47 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:10:47 user nova-compute[75258]:   </os>
Nov 14 13:10:47 user nova-compute[75258]:   <features>
Nov 14 13:10:47 user nova-compute[75258]:     <acpi/>
Nov 14 13:10:47 user nova-compute[75258]:     <apic/>
Nov 14 13:10:47 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:10:47 user nova-compute[75258]:   </features>
Nov 14 13:10:47 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:10:47 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:10:47 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:10:47 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:10:47 user nova-compute[75258]:   </clock>
Nov 14 13:10:47 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:10:47 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:10:47 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:10:47 user nova-compute[75258]:   </cpu>
Nov 14 13:10:47 user nova-compute[75258]:   <devices>
Nov 14 13:10:47 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:10:47 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:10:47 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk"/>
Nov 14 13:10:47 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:10:47 user nova-compute[75258]:     </disk>
Nov 14 13:10:47 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:10:47 user nova-compute[75258]:       <mac address="fa:16:3e:66:97:29"/>
Nov 14 13:10:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:10:47 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:10:47 user nova-compute[75258]:       <target dev="tape2d9a065-a0"/>
Nov 14 13:10:47 user nova-compute[75258]:     </interface>
Nov 14 13:10:47 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:10:47 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/console.log" append="off"/>
Nov 14 13:10:47 user nova-compute[75258]:     </serial>
Nov 14 13:10:47 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:10:47 user nova-compute[75258]:     <video>
Nov 14 13:10:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:10:47 user nova-compute[75258]:     </video>
Nov 14 13:10:47 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:10:47 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:10:47 user nova-compute[75258]:     </rng>
Nov 14 13:10:47 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:10:47 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:10:47 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:10:47 user nova-compute[75258]:     </memballoon>
Nov 14 13:10:47 user nova-compute[75258]:   </devices>
Nov 14 13:10:47 user nova-compute[75258]: </domain>
Nov 14 13:10:47 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-867286604',display_name='tempest-ServerRescueNegativeTestJSON-server-867286604',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-867286604',id=44,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM23RcspOGpf6mxrhVn91aprJVcDVarX36t7E4xlXnpXOnU2OlE317MwVsytw4xFMNUSJuOR5Wo3DTbBHXNHQ53eOwYdQZAFipd5Jv4WQvJxa6S6AdqkNasy+Tp1ob57gA==',key_name='tempest-keypair-1585408966',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-seiugfrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:10:46Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5106602814f6478fad50a7273995c8b9',uuid=44c12330-6c43-4e2a-a3ae-ea1542c76a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG os_vif [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e236b9f4-6852-5e3f-92a2-2fddcd6f458b', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape2d9a065-a0, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape2d9a065-a0, col_values=(('qos', UUID('3f1507ff-3ed1-40fc-94d5-5baa01d08533')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape2d9a065-a0, col_values=(('external_ids', {'iface-id': 'e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:66:97:29', 'vm-uuid': '44c12330-6c43-4e2a-a3ae-ea1542c76a63'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:47 user nova-compute[75258]: INFO os_vif [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0')
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No VIF found with MAC fa:16:3e:66:97:29, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updated VIF entry in instance network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG nova.network.neutron [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:10:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1e491b55-4266-4828-8d1f-fc5602ee2762 req-f6c9d742-0f86-4f8b-a1bb-d3e6e12f5745 service nova] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:10:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:10:49 user nova-compute[75258]: WARNING nova.compute.manager [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state building and task_state spawning.
Nov 14 13:10:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:10:49 user nova-compute[75258]: WARNING nova.compute.manager [req-8ea15fc6-4d1d-4c49-84ac-0be4d392d208 req-0f72bd67-3af9-474a-a987-8de18da417af service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state building and task_state spawning.
Nov 14 13:10:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:10:50 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance spawned successfully.
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:10:50 user nova-compute[75258]: INFO nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Took 5.01 seconds to spawn the instance on the hypervisor.
Nov 14 13:10:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:10:51 user nova-compute[75258]: INFO nova.compute.manager [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Took 5.58 seconds to build instance.
Nov 14 13:10:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a5011b2c-2c19-476a-8658-0b9d6d3d2d80 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.664s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:10:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:10:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:10:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:10:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:10:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:10:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:11:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:32 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:11:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:11:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:11:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:11:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:39 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:11:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:11:41 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:11:41 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8854MB free_disk=25.066844940185547GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:11:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.298s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:11:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:11:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:11:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verify base images {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Image id b293cbf1-70d3-49f7-8a42-771d90e2ec06 yields fingerprint 5953b672b09d92bbfe59816f074eff61dfd18dae {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 13:12:01 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] image b293cbf1-70d3-49f7-8a42-771d90e2ec06 at (/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae): checking
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] image b293cbf1-70d3-49f7-8a42-771d90e2ec06 at (/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae): image is in use {{(pid=75258) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 is a valid instance name {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 has a disk file {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 is backed by 5953b672b09d92bbfe59816f074eff61dfd18dae {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 6f4e59bf-246f-4490-8c6a-71b39185fc17 is a valid instance name {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 6f4e59bf-246f-4490-8c6a-71b39185fc17 has a disk file {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 is backed by 5953b672b09d92bbfe59816f074eff61dfd18dae {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 44c12330-6c43-4e2a-a3ae-ea1542c76a63 is a valid instance name {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 44c12330-6c43-4e2a-a3ae-ea1542c76a63 has a disk file {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 13:12:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 is backed by 5953b672b09d92bbfe59816f074eff61dfd18dae {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 13:12:02 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e
Nov 14 13:12:02 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679
Nov 14 13:12:02 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0
Nov 14 13:12:02 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96
Nov 14 13:12:02 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c
Nov 14 13:12:02 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47
Nov 14 13:12:02 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Active base files: /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Removable base files: /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0 /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47 /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47
Nov 14 13:12:02 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7
Nov 14 13:12:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verification complete {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 13:12:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verify swap images {{(pid=75258) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 13:12:02 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verify ephemeral images {{(pid=75258) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 13:12:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:12:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:12:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:12:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:12:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:12:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:12:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:12:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:12:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:12:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:12:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:12:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:12:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:12:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:12:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:12:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:12:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:12:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing instance network info cache due to event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'flavor' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.051s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updated VIF entry in instance network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6a317ecf-a25d-415f-9d32-f94f55e3c37e req-4cea03e4-197a-46be-9df1-a02d8624cc10 service nova] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:36 user nova-compute[75258]: INFO nova.compute.manager [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Attaching volume 2e8d0917-800e-4b04-969e-908da639a831 to /dev/vdb
Nov 14 13:12:36 user nova-compute[75258]: DEBUG os_brick.utils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09185e3-224f-4b70-8160-cf53a7a40fd9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed7dc033-65c1-4a76-9809-fd2a6fed362d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a7205fc-6912-48e9-8534-d1ee35403a95]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[10e7ebe0-0830-49f3-b087-181e5cd62c45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:36 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:12:37 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:12:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77af9bed-561e-4e4c-866a-e6b71d880065]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG os_brick.utils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating existing volume attachment record: 1be83316-1f72-43ba-8ff0-8b682aaba2fb {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:12:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBqFKnte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:12:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:12:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:12:41 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7fe69d-e13b-44c6-b01b-3e74085b776c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:12:41 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7b107c3-94cd-4bdf-990b-67bfb7a10567]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831] added
Nov 14 13:12:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.040s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[351bd63d-1c0d-45ad-ac15-177f91805e4d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdd88dd-1d83-44d5-a663-2cd8805ad759]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBqFKnte {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iBqFKnte" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e456873c-707b-4c74-8489-9548500ef926]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iBqFKnte'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8946f51-6328-4312-8952-248dce88ec9a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[22a7e02b-6064-4a3a-a813-286e4bf80ea9]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:12:41 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:12:41 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:12:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:12:41 user nova-compute[75258]: 
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2a03736-14aa-4e55-9085-6c7e7527cdb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260]
Nov 14 13:12:41 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260] successful.
Nov 14 13:12:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9faa0623-0c8a-4a03-b16c-6761a5ae9ea9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[70072072-b51c-4511-aa2d-191324da221c]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 (non-flash)
Nov 14 13:12:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 (non-flash)
Nov 14 13:12:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.335s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] HCTL ('33', '-', '-', 0) found on session 56 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[667197df-0cb1-4cc9-ba8d-b382718f366f]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.167s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching for a device in session 56 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBqFKnte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.397s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] <== connect_volume: return (1400ms) {'type': 'block', 'scsi_wwn': '26132633961336465', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132633961336465', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'flavor' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 13:12:42 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:12:42 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:12:42 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:12:42 user nova-compute[75258]:   <serial>2e8d0917-800e-4b04-969e-908da639a831</serial>
Nov 14 13:12:42 user nova-compute[75258]: </disk>
Nov 14 13:12:42 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:43 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:12:43 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8918MB free_disk=25.066070556640625GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No VIF found with MAC fa:16:3e:66:97:29, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3305e5b0-308b-4bb0-851f-ceb306e06076 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.686s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:12:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.228s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:44 user nova-compute[75258]: INFO nova.compute.manager [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Rescuing
Nov 14 13:12:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:12:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:12:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:12:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG nova.compute.manager [req-859150b4-e574-40c0-b78a-a96702326da0 req-035f76f4-df6d-4c20-893c-31acbf430e4a service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-859150b4-e574-40c0-b78a-a96702326da0 req-035f76f4-df6d-4c20-893c-31acbf430e4a service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-859150b4-e574-40c0-b78a-a96702326da0 req-035f76f4-df6d-4c20-893c-31acbf430e4a service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-859150b4-e574-40c0-b78a-a96702326da0 req-035f76f4-df6d-4c20-893c-31acbf430e4a service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG nova.compute.manager [req-859150b4-e574-40c0-b78a-a96702326da0 req-035f76f4-df6d-4c20-893c-31acbf430e4a service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:45 user nova-compute[75258]: WARNING nova.compute.manager [req-859150b4-e574-40c0-b78a-a96702326da0 req-035f76f4-df6d-4c20-893c-31acbf430e4a service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance destroyed successfully.
Nov 14 13:12:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Attempting rescue
Nov 14 13:12:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=75258) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4318}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance directory exists: not creating {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4723}}
Nov 14 13:12:45 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Creating image(s)
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'trusted_certs' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.rescue {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.rescue" returned: 0 in 0.052s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.242s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'migration_context' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.base [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<44c12330-6c43-4e2a-a3ae-ea1542c76a63> lazy-loaded attributes: trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Start _get_guest_xml network_info=[{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:66:97:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'resources' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.base [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<44c12330-6c43-4e2a-a3ae-ea1542c76a63> lazy-loaded attributes: trusted_certs,migration_context,resources {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'numa_topology' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.base [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<44c12330-6c43-4e2a-a3ae-ea1542c76a63> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:12:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:12:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'vcpu_model' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.base [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<44c12330-6c43-4e2a-a3ae-ea1542c76a63> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-867286604',display_name='tempest-ServerRescueNegativeTestJSON-server-867286604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-867286604',id=44,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM23RcspOGpf6mxrhVn91aprJVcDVarX36t7E4xlXnpXOnU2OlE317MwVsytw4xFMNUSJuOR5Wo3DTbBHXNHQ53eOwYdQZAFipd5Jv4WQvJxa6S6AdqkNasy+Tp1ob57gA==',key_name='tempest-keypair-1585408966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:10:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-seiugfrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:10:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5106602814f6478fad50a7273995c8b9',uuid=44c12330-6c43-4e2a-a3ae-ea1542c76a63,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:66:97:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "vif_mac": "fa:16:3e:66:97:29"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'pci_devices' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.objects.base [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Object Instance<44c12330-6c43-4e2a-a3ae-ea1542c76a63> lazy-loaded attributes: trusted_certs,migration_context,resources,numa_topology,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:12:46 user nova-compute[75258]:   <uuid>44c12330-6c43-4e2a-a3ae-ea1542c76a63</uuid>
Nov 14 13:12:46 user nova-compute[75258]:   <name>instance-0000002c</name>
Nov 14 13:12:46 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:12:46 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:12:46 user nova-compute[75258]:   <metadata>
Nov 14 13:12:46 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:12:46 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:12:46 user nova-compute[75258]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-867286604</nova:name>
Nov 14 13:12:46 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:12:46</nova:creationTime>
Nov 14 13:12:46 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:12:46 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:12:46 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:12:46 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:12:46 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:12:46 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:12:46 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:12:46 user nova-compute[75258]:       <nova:owner>
Nov 14 13:12:46 user nova-compute[75258]:         <nova:user uuid="5106602814f6478fad50a7273995c8b9">tempest-ServerRescueNegativeTestJSON-607907589-project-member</nova:user>
Nov 14 13:12:46 user nova-compute[75258]:         <nova:project uuid="2b1b14d580c640bcbbd8ce084f5872a2">tempest-ServerRescueNegativeTestJSON-607907589</nova:project>
Nov 14 13:12:46 user nova-compute[75258]:       </nova:owner>
Nov 14 13:12:46 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:12:46 user nova-compute[75258]:       <nova:ports>
Nov 14 13:12:46 user nova-compute[75258]:         <nova:port uuid="e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc">
Nov 14 13:12:46 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Nov 14 13:12:46 user nova-compute[75258]:         </nova:port>
Nov 14 13:12:46 user nova-compute[75258]:       </nova:ports>
Nov 14 13:12:46 user nova-compute[75258]:     </nova:instance>
Nov 14 13:12:46 user nova-compute[75258]:   </metadata>
Nov 14 13:12:46 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:12:46 user nova-compute[75258]:     <system>
Nov 14 13:12:46 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:12:46 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:12:46 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:12:46 user nova-compute[75258]:       <entry name="serial">44c12330-6c43-4e2a-a3ae-ea1542c76a63</entry>
Nov 14 13:12:46 user nova-compute[75258]:       <entry name="uuid">44c12330-6c43-4e2a-a3ae-ea1542c76a63</entry>
Nov 14 13:12:46 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:12:46 user nova-compute[75258]:     </system>
Nov 14 13:12:46 user nova-compute[75258]:   </sysinfo>
Nov 14 13:12:46 user nova-compute[75258]:   <os>
Nov 14 13:12:46 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:12:46 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:12:46 user nova-compute[75258]:   </os>
Nov 14 13:12:46 user nova-compute[75258]:   <features>
Nov 14 13:12:46 user nova-compute[75258]:     <acpi/>
Nov 14 13:12:46 user nova-compute[75258]:     <apic/>
Nov 14 13:12:46 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:12:46 user nova-compute[75258]:   </features>
Nov 14 13:12:46 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:12:46 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:12:46 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:12:46 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:12:46 user nova-compute[75258]:   </clock>
Nov 14 13:12:46 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:12:46 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:12:46 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:12:46 user nova-compute[75258]:   </cpu>
Nov 14 13:12:46 user nova-compute[75258]:   <devices>
Nov 14 13:12:46 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:12:46 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:12:46 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.rescue"/>
Nov 14 13:12:46 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:12:46 user nova-compute[75258]:     </disk>
Nov 14 13:12:46 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:12:46 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:12:46 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk"/>
Nov 14 13:12:46 user nova-compute[75258]:       <target dev="vdb" bus="virtio"/>
Nov 14 13:12:46 user nova-compute[75258]:     </disk>
Nov 14 13:12:46 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:12:46 user nova-compute[75258]:       <mac address="fa:16:3e:66:97:29"/>
Nov 14 13:12:46 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:12:46 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:12:46 user nova-compute[75258]:       <target dev="tape2d9a065-a0"/>
Nov 14 13:12:46 user nova-compute[75258]:     </interface>
Nov 14 13:12:46 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:12:46 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/console.log" append="off"/>
Nov 14 13:12:46 user nova-compute[75258]:     </serial>
Nov 14 13:12:46 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:12:46 user nova-compute[75258]:     <video>
Nov 14 13:12:46 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:12:46 user nova-compute[75258]:     </video>
Nov 14 13:12:46 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:12:46 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:12:46 user nova-compute[75258]:     </rng>
Nov 14 13:12:46 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:12:46 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:12:46 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:12:46 user nova-compute[75258]:     </memballoon>
Nov 14 13:12:46 user nova-compute[75258]:   </devices>
Nov 14 13:12:46 user nova-compute[75258]: </domain>
Nov 14 13:12:46 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:12:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance destroyed successfully.
Nov 14 13:12:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:12:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] No VIF found with MAC fa:16:3e:66:97:29, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:47 user nova-compute[75258]: WARNING nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:47 user nova-compute[75258]: WARNING nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:47 user nova-compute[75258]: WARNING nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:47 user nova-compute[75258]: WARNING nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:47 user nova-compute[75258]: WARNING nova.compute.manager [req-3f26ac2e-a307-4ccf-8df5-edb446095a28 req-163c66b3-9122-4d16-9866-2e68a3e4efaf service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:49 user nova-compute[75258]: WARNING nova.compute.manager [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:12:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:12:49 user nova-compute[75258]: WARNING nova.compute.manager [req-90ba4480-dcd1-4ba7-ab2c-05fbc9f6df34 req-40d6f452-0a7d-4837-9a1f-55a712cd4c9e service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state active and task_state rescuing.
Nov 14 13:12:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-c98ddb37-dada-434f-9146-fc956bf18bf2 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:12:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:57 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:12:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:12:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:12:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:12:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:13:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:13:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:13:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:13:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:13:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:13:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.029s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:13:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:13:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:13:43 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:13:43 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8878MB free_disk=25.056377410888672GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:13:43 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.465s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:13:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:13:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:13:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:13:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:13:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:13:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:13:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:14:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:14:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:14:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:14:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:14:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:14:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:14:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:14:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:14:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:14:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:35 user nova-compute[75258]: INFO nova.compute.manager [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Unrescuing
Nov 14 13:14:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:14:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:14:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG nova.objects.instance [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'flavor' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-9a2b82e4-87a1-487d-b4c3-7e465e6b312c req-5946e008-7b07-4c30-a6d7-3a6907a4b172 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9a2b82e4-87a1-487d-b4c3-7e465e6b312c req-5946e008-7b07-4c30-a6d7-3a6907a4b172 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9a2b82e4-87a1-487d-b4c3-7e465e6b312c req-5946e008-7b07-4c30-a6d7-3a6907a4b172 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9a2b82e4-87a1-487d-b4c3-7e465e6b312c req-5946e008-7b07-4c30-a6d7-3a6907a4b172 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-9a2b82e4-87a1-487d-b4c3-7e465e6b312c req-5946e008-7b07-4c30-a6d7-3a6907a4b172 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:36 user nova-compute[75258]: WARNING nova.compute.manager [req-9a2b82e4-87a1-487d-b4c3-7e465e6b312c req-5946e008-7b07-4c30-a6d7-3a6907a4b172 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance destroyed successfully.
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:14:38 user nova-compute[75258]: WARNING nova.compute.manager [req-d9d199c3-d188-4030-bf86-698938af1220 req-d7a971d6-1e62-4548-a33a-2d1f6c7f73c1 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state rescued and task_state unrescuing.
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:14:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:14:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-97aeccf7-2961-4fb9-8ea4-177acb47f56e tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:14:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:42 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.188s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.201s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:43 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:14:44 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:14:44 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8949MB free_disk=25.055320739746094GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:14:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.251s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:14:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:14:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:14:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:14:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:14:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:14:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:14:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:14:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:14:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:15:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:15:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:15:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:15:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:15:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:15:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [{"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-2fb87e79-f7a8-4bfc-924f-cec1e3d45268" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:15:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:15:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:15:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:15:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:15:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:15:43 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:15:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:15:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:15:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8913MB free_disk=25.054527282714844GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:15:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:15:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:15:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:15:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:15:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:15:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:16:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing instance network info cache due to event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:16:27 user nova-compute[75258]: INFO nova.compute.manager [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Detaching volume 2e8d0917-800e-4b04-969e-908da639a831
Nov 14 13:16:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:27 user nova-compute[75258]: INFO nova.virt.block_device [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Attempting to driver detach volume 2e8d0917-800e-4b04-969e-908da639a831 from mountpoint /dev/vdb
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Attempting to detach device vdb from instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:16:27 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:16:27 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:16:27 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:16:27 user nova-compute[75258]:   <serial>2e8d0917-800e-4b04-969e-908da639a831</serial>
Nov 14 13:16:27 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:16:27 user nova-compute[75258]: </disk>
Nov 14 13:16:27 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:16:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully detached device vdb from instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 from the persistent domain config.
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:16:27 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:16:27 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:16:27 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:16:27 user nova-compute[75258]:   <serial>2e8d0917-800e-4b04-969e-908da639a831</serial>
Nov 14 13:16:27 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:16:27 user nova-compute[75258]: </disk>
Nov 14 13:16:27 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updated VIF entry in instance network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:16:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a93fbbfb-1406-4ab7-9966-096c485887e6 req-f11248c5-fe9d-4982-b547-80ceb7c01193 service nova] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:16:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG nova.compute.manager [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing instance network info cache due to event network-changed-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Refreshing network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updated VIF entry in instance network info cache for port e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:16:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-2eb80b73-523a-48db-8093-67f32d4517be req-24187680-f93d-4389-bbd7-d37c66e708d8 service nova] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:16:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:16:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:40 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:16:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:16:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:16:40 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:16:41 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [{"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:16:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-44c12330-6c43-4e2a-a3ae-ea1542c76a63" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:16:41 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:16:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:45 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.168s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:16:47 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8906MB free_disk=25.053829193115234GB free_vcpus=9 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 3 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=2048MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=3 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.218s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:16:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:48 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 is timed out.
Nov 14 13:16:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully detached device vdb from instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63 from the live domain config.
Nov 14 13:16:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iBqFKnte', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:16:48 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f6ca66c-5810-441b-8a19-37cb21b79581]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:16:48 user nova-compute[75258]: No targets found.
Nov 14 13:16:48 user nova-compute[75258]: iSNS:
Nov 14 13:16:48 user nova-compute[75258]: No targets found.
Nov 14 13:16:48 user nova-compute[75258]: STATIC:
Nov 14 13:16:48 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831
Nov 14 13:16:48 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:16:48 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:16:48 user nova-compute[75258]: FIRMWARE:
Nov 14 13:16:48 user nova-compute[75258]: No targets found.
Nov 14 13:16:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:16:48 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:16:48 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc36a10-4620-441c-aca5-00ad400edc44]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77acaba2-c05f-4bee-8d83-49bf7b123699]: (4, ('tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 (non-flash)
Nov 14 13:16:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsi session list stdout=tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 (non-flash)
Nov 14 13:16:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7657e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cccffaa-f6b9-45d9-b8ea-49b43a172468]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[00be7d38-1746-4b58-9911-c46e4119ce3b]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2e8424-d536-47ea-a5a2-de7ad5194a51]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd1ea662-492a-4014-bcf1-55fe44e5148e]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3870e587-3044-4b8e-8e3c-6abe045cb713]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --logout" returned: 0 in 0.048s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1722d7f4-1df8-4ccc-8746-3485eb10bb30]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260]
Nov 14 13:16:48 user nova-compute[75258]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831, portal: 172.16.0.220,3260] successful.
Nov 14 13:16:48 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2e8d0917-800e-4b04-969e-908da639a831 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7bbcd64-a8f1-446b-bddb-e42e073796c4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.269s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] <== disconnect_volume: return (271ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:16:48 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:16:49 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'flavor' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:16:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b90d5483-2d8d-495c-b75c-f8113f77ac77 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.641s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:16:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:16:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:16:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:16:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:16:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:16:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:16:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:17:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:17:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:17:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:17:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:17:17 user nova-compute[75258]: INFO nova.compute.manager [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Terminating instance
Nov 14 13:17:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f89f270d-172f-476f-8bf1-1a9c1a06fac5 req-33b357e7-eef9-46f2-b40c-bded919924aa service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f89f270d-172f-476f-8bf1-1a9c1a06fac5 req-33b357e7-eef9-46f2-b40c-bded919924aa service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f89f270d-172f-476f-8bf1-1a9c1a06fac5 req-33b357e7-eef9-46f2-b40c-bded919924aa service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f89f270d-172f-476f-8bf1-1a9c1a06fac5 req-33b357e7-eef9-46f2-b40c-bded919924aa service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f89f270d-172f-476f-8bf1-1a9c1a06fac5 req-33b357e7-eef9-46f2-b40c-bded919924aa service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.compute.manager [req-f89f270d-172f-476f-8bf1-1a9c1a06fac5 req-33b357e7-eef9-46f2-b40c-bded919924aa service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-unplugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Instance destroyed successfully.
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'resources' on Instance uuid 44c12330-6c43-4e2a-a3ae-ea1542c76a63 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:10:44Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-867286604',display_name='tempest-ServerRescueNegativeTestJSON-server-867286604',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-867286604',id=44,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM23RcspOGpf6mxrhVn91aprJVcDVarX36t7E4xlXnpXOnU2OlE317MwVsytw4xFMNUSJuOR5Wo3DTbBHXNHQ53eOwYdQZAFipd5Jv4WQvJxa6S6AdqkNasy+Tp1ob57gA==',key_name='tempest-keypair-1585408966',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:12:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-seiugfrb',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:14:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='5106602814f6478fad50a7273995c8b9',uuid=44c12330-6c43-4e2a-a3ae-ea1542c76a63,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "address": "fa:16:3e:66:97:29", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.29", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape2d9a065-a0", "ovs_interfaceid": "e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG os_vif [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape2d9a065-a0, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=3f1507ff-3ed1-40fc-94d5-5baa01d08533) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:18 user nova-compute[75258]: INFO os_vif [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:66:97:29,bridge_name='br-int',has_traffic_filtering=True,id=e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape2d9a065-a0')
Nov 14 13:17:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Deleting instance files /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63_del
Nov 14 13:17:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Deletion of /opt/stack/data/nova/instances/44c12330-6c43-4e2a-a3ae-ea1542c76a63_del complete
Nov 14 13:17:18 user nova-compute[75258]: INFO nova.compute.manager [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Took 0.84 seconds to destroy the instance on the hypervisor.
Nov 14 13:17:18 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:17:18 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:17:19 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:17:19 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Took 0.62 seconds to deallocate network for instance.
Nov 14 13:17:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:17:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:17:19 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:17:19 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:17:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:17:19 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Deleted allocations for instance 44c12330-6c43-4e2a-a3ae-ea1542c76a63
Nov 14 13:17:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d0de9761-2996-494f-9774-df1ebe296c13 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.817s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:17:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-8e29b278-1240-4616-84cc-a017e7d85f1b req-9d526b3b-565c-4ea1-9d2e-614328856f19 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:17:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8e29b278-1240-4616-84cc-a017e7d85f1b req-9d526b3b-565c-4ea1-9d2e-614328856f19 service nova] Acquiring lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:17:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8e29b278-1240-4616-84cc-a017e7d85f1b req-9d526b3b-565c-4ea1-9d2e-614328856f19 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:17:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8e29b278-1240-4616-84cc-a017e7d85f1b req-9d526b3b-565c-4ea1-9d2e-614328856f19 service nova] Lock "44c12330-6c43-4e2a-a3ae-ea1542c76a63-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:17:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-8e29b278-1240-4616-84cc-a017e7d85f1b req-9d526b3b-565c-4ea1-9d2e-614328856f19 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] No waiting events found dispatching network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:17:20 user nova-compute[75258]: WARNING nova.compute.manager [req-8e29b278-1240-4616-84cc-a017e7d85f1b req-9d526b3b-565c-4ea1-9d2e-614328856f19 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received unexpected event network-vif-plugged-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc for instance with vm_state deleted and task_state None.
Nov 14 13:17:20 user nova-compute[75258]: DEBUG nova.compute.manager [req-8e29b278-1240-4616-84cc-a017e7d85f1b req-9d526b3b-565c-4ea1-9d2e-614328856f19 service nova] [instance: 44c12330-6c43-4e2a-a3ae-ea1542c76a63] Received event network-vif-deleted-e2d9a065-a0b5-4cb7-9f9c-4fd02b1577bc {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:17:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:17:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:17:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:17:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [{"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-6f4e59bf-246f-4490-8c6a-71b39185fc17" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:17:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:17:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:17:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:17:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk.rescue --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:17:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:17:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:17:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:17:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:17:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9012MB free_disk=25.081199645996094GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:17:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.259s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:17:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:17:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:17:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:17:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:18:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:18:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:18:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:18:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:18:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:18:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:18:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:18:13 user nova-compute[75258]: INFO nova.compute.manager [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Terminating instance
Nov 14 13:18:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:18:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-71add69d-b1c4-4e1c-b230-3a0d14131bbd req-4759ce8c-7b0e-4077-aa56-a3ff3fbf216d service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-unplugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-71add69d-b1c4-4e1c-b230-3a0d14131bbd req-4759ce8c-7b0e-4077-aa56-a3ff3fbf216d service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-71add69d-b1c4-4e1c-b230-3a0d14131bbd req-4759ce8c-7b0e-4077-aa56-a3ff3fbf216d service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-71add69d-b1c4-4e1c-b230-3a0d14131bbd req-4759ce8c-7b0e-4077-aa56-a3ff3fbf216d service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-71add69d-b1c4-4e1c-b230-3a0d14131bbd req-4759ce8c-7b0e-4077-aa56-a3ff3fbf216d service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-unplugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-71add69d-b1c4-4e1c-b230-3a0d14131bbd req-4759ce8c-7b0e-4077-aa56-a3ff3fbf216d service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-unplugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:18:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Instance destroyed successfully.
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.objects.instance [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'resources' on Instance uuid 2fb87e79-f7a8-4bfc-924f-cec1e3d45268 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-2095679056',display_name='tempest-ServerRescueNegativeTestJSON-server-2095679056',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-2095679056',id=42,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:04:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-x3pfcjkx',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:04:12Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=2fb87e79-f7a8-4bfc-924f-cec1e3d45268,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "address": "fa:16:3e:e8:5c:b8", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap26b28578-22", "ovs_interfaceid": "26b28578-229d-4ad6-8ae4-d088ef0016f9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG os_vif [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap26b28578-22, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=e555a8bd-a09c-4513-b2f3-6603564231cf) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:14 user nova-compute[75258]: INFO os_vif [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e8:5c:b8,bridge_name='br-int',has_traffic_filtering=True,id=26b28578-229d-4ad6-8ae4-d088ef0016f9,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap26b28578-22')
Nov 14 13:18:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Deleting instance files /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268_del
Nov 14 13:18:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Deletion of /opt/stack/data/nova/instances/2fb87e79-f7a8-4bfc-924f-cec1e3d45268_del complete
Nov 14 13:18:14 user nova-compute[75258]: INFO nova.compute.manager [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Took 0.67 seconds to destroy the instance on the hypervisor.
Nov 14 13:18:14 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:18:14 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Took 0.36 seconds to deallocate network for instance.
Nov 14 13:18:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:18:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:18:15 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:18:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:18:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.332s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:18:15 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Deleted allocations for instance 2fb87e79-f7a8-4bfc-924f-cec1e3d45268
Nov 14 13:18:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-09989f8d-8be3-4957-98d5-5a74c7955ae9 tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.548s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:18:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-5856b328-f9c2-43ee-8efe-6cf8506bca21 req-3566c42f-71b5-4536-b6b0-34b925e121db service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:18:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5856b328-f9c2-43ee-8efe-6cf8506bca21 req-3566c42f-71b5-4536-b6b0-34b925e121db service nova] Acquiring lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:18:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5856b328-f9c2-43ee-8efe-6cf8506bca21 req-3566c42f-71b5-4536-b6b0-34b925e121db service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:18:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-5856b328-f9c2-43ee-8efe-6cf8506bca21 req-3566c42f-71b5-4536-b6b0-34b925e121db service nova] Lock "2fb87e79-f7a8-4bfc-924f-cec1e3d45268-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:18:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-5856b328-f9c2-43ee-8efe-6cf8506bca21 req-3566c42f-71b5-4536-b6b0-34b925e121db service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] No waiting events found dispatching network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:18:16 user nova-compute[75258]: WARNING nova.compute.manager [req-5856b328-f9c2-43ee-8efe-6cf8506bca21 req-3566c42f-71b5-4536-b6b0-34b925e121db service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received unexpected event network-vif-plugged-26b28578-229d-4ad6-8ae4-d088ef0016f9 for instance with vm_state deleted and task_state None.
Nov 14 13:18:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-5856b328-f9c2-43ee-8efe-6cf8506bca21 req-3566c42f-71b5-4536-b6b0-34b925e121db service nova] [instance: 2fb87e79-f7a8-4bfc-924f-cec1e3d45268] Received event network-vif-deleted-26b28578-229d-4ad6-8ae4-d088ef0016f9 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:18:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:18:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:18:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:18:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:43 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:43 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:18:43 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:18:47 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:18:48 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:18:48 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9088MB free_disk=25.10860824584961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 6f4e59bf-246f-4490-8c6a-71b39185fc17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:18:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.421s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:18:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:18:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:18:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:18:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:18:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:18:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:18:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:18:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:19:04 user nova-compute[75258]: INFO nova.compute.manager [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Terminating instance
Nov 14 13:19:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-afe127a0-336f-4287-a3da-2ac733d414c8 req-bbf3a853-b1f4-4000-9494-fecc247abd37 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-afe127a0-336f-4287-a3da-2ac733d414c8 req-bbf3a853-b1f4-4000-9494-fecc247abd37 service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-afe127a0-336f-4287-a3da-2ac733d414c8 req-bbf3a853-b1f4-4000-9494-fecc247abd37 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-afe127a0-336f-4287-a3da-2ac733d414c8 req-bbf3a853-b1f4-4000-9494-fecc247abd37 service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-afe127a0-336f-4287-a3da-2ac733d414c8 req-bbf3a853-b1f4-4000-9494-fecc247abd37 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-afe127a0-336f-4287-a3da-2ac733d414c8 req-bbf3a853-b1f4-4000-9494-fecc247abd37 service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-unplugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:19:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Instance destroyed successfully.
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.objects.instance [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lazy-loading 'resources' on Instance uuid 6f4e59bf-246f-4490-8c6a-71b39185fc17 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:02:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-494633960',display_name='tempest-ServerRescueNegativeTestJSON-server-494633960',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-494633960',id=41,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:07:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2b1b14d580c640bcbbd8ce084f5872a2',ramdisk_id='',reservation_id='r-fh3gql35',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-607907589',owner_user_name='tempest-ServerRescueNegativeTestJSON-607907589-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:08:55Z,user_data=None,user_id='5106602814f6478fad50a7273995c8b9',uuid=6f4e59bf-246f-4490-8c6a-71b39185fc17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converting VIF {"id": "73ccdfd9-b72c-4945-ac09-05a199745af0", "address": "fa:16:3e:e0:e9:74", "network": {"id": "9aeebdbe-da39-466f-8b92-6a7486960a59", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-669907451-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2b1b14d580c640bcbbd8ce084f5872a2", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap73ccdfd9-b7", "ovs_interfaceid": "73ccdfd9-b72c-4945-ac09-05a199745af0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG os_vif [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap73ccdfd9-b7, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1b7fe84d-b551-4242-93f6-31a45f0d40b9) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:05 user nova-compute[75258]: INFO os_vif [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e0:e9:74,bridge_name='br-int',has_traffic_filtering=True,id=73ccdfd9-b72c-4945-ac09-05a199745af0,network=Network(9aeebdbe-da39-466f-8b92-6a7486960a59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap73ccdfd9-b7')
Nov 14 13:19:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Deleting instance files /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17_del
Nov 14 13:19:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Deletion of /opt/stack/data/nova/instances/6f4e59bf-246f-4490-8c6a-71b39185fc17_del complete
Nov 14 13:19:05 user nova-compute[75258]: INFO nova.compute.manager [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Took 0.85 seconds to destroy the instance on the hypervisor.
Nov 14 13:19:05 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:19:05 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Took 0.42 seconds to deallocate network for instance.
Nov 14 13:19:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:19:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.126s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:19:05 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Deleted allocations for instance 6f4e59bf-246f-4490-8c6a-71b39185fc17
Nov 14 13:19:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-23aae88f-4a84-4795-8b99-a3df7df8875a tempest-ServerRescueNegativeTestJSON-607907589 tempest-ServerRescueNegativeTestJSON-607907589-project-member] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.582s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:19:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-0a6f36c6-8991-49ec-b3b3-7714c639be72 req-833a5896-9b2c-4483-aaa0-2f1fa0e12e0a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:19:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0a6f36c6-8991-49ec-b3b3-7714c639be72 req-833a5896-9b2c-4483-aaa0-2f1fa0e12e0a service nova] Acquiring lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:19:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0a6f36c6-8991-49ec-b3b3-7714c639be72 req-833a5896-9b2c-4483-aaa0-2f1fa0e12e0a service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:19:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-0a6f36c6-8991-49ec-b3b3-7714c639be72 req-833a5896-9b2c-4483-aaa0-2f1fa0e12e0a service nova] Lock "6f4e59bf-246f-4490-8c6a-71b39185fc17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:19:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-0a6f36c6-8991-49ec-b3b3-7714c639be72 req-833a5896-9b2c-4483-aaa0-2f1fa0e12e0a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] No waiting events found dispatching network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:19:06 user nova-compute[75258]: WARNING nova.compute.manager [req-0a6f36c6-8991-49ec-b3b3-7714c639be72 req-833a5896-9b2c-4483-aaa0-2f1fa0e12e0a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received unexpected event network-vif-plugged-73ccdfd9-b72c-4945-ac09-05a199745af0 for instance with vm_state deleted and task_state None.
Nov 14 13:19:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-0a6f36c6-8991-49ec-b3b3-7714c639be72 req-833a5896-9b2c-4483-aaa0-2f1fa0e12e0a service nova] [instance: 6f4e59bf-246f-4490-8c6a-71b39185fc17] Received event network-vif-deleted-73ccdfd9-b72c-4945-ac09-05a199745af0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:19:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:19:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:19:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:19:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:38 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:19:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:19:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:19:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:19:48 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:19:48 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:19:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9221MB free_disk=25.13613510131836GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:19:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.151s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:19:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:19:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:19:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:19:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:19:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:19:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:19:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:19:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:20:08 user nova-compute[75258]: INFO nova.compute.claims [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Claim successful on node user
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.212s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:20:08 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.policy [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6814fc9e62e247a4a44fc2314a6a672b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a39c79a82140aba72b492ccb9a7f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:20:08 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Creating image(s)
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:08 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk 1073741824" returned: 0 in 0.052s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.231s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Successfully created port: 79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Cannot resize image /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Ensure instance console log exists: /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Successfully updated port: 79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:20:09 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing instance network info cache due to event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance network_info: |[{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Start _get_guest_xml network_info=[{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:20:10 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:20:10 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568984256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568984256',id=45,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqqudFIc/LtSn82Mj/+EbDPNLWNBSjwhN7cRVamyAYStoInIBT+HIMtEkT6mrq8RQcSCSeMYhZYZy5WKKxs5Rya7KBW3GVpXAwUorlTPgX4VSqqfH8WosucCvyCMHRrxg==',key_name='tempest-keypair-1658443247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-3caaof4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=5b541fb3-03f2-4c04-9e46-59a226840caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:20:10 user nova-compute[75258]:   <uuid>5b541fb3-03f2-4c04-9e46-59a226840caf</uuid>
Nov 14 13:20:10 user nova-compute[75258]:   <name>instance-0000002d</name>
Nov 14 13:20:10 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:20:10 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:20:10 user nova-compute[75258]:   <metadata>
Nov 14 13:20:10 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:20:10 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:20:10 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1568984256</nova:name>
Nov 14 13:20:10 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:20:10</nova:creationTime>
Nov 14 13:20:10 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:20:10 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:20:10 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:20:10 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:20:10 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:20:10 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:20:10 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:20:10 user nova-compute[75258]:       <nova:owner>
Nov 14 13:20:10 user nova-compute[75258]:         <nova:user uuid="6814fc9e62e247a4a44fc2314a6a672b">tempest-AttachVolumeShelveTestJSON-1949023058-project-member</nova:user>
Nov 14 13:20:10 user nova-compute[75258]:         <nova:project uuid="34a39c79a82140aba72b492ccb9a7f8f">tempest-AttachVolumeShelveTestJSON-1949023058</nova:project>
Nov 14 13:20:10 user nova-compute[75258]:       </nova:owner>
Nov 14 13:20:10 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:20:10 user nova-compute[75258]:       <nova:ports>
Nov 14 13:20:10 user nova-compute[75258]:         <nova:port uuid="79d02bbe-a080-44a1-8238-8728eeba748c">
Nov 14 13:20:10 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 13:20:10 user nova-compute[75258]:         </nova:port>
Nov 14 13:20:10 user nova-compute[75258]:       </nova:ports>
Nov 14 13:20:10 user nova-compute[75258]:     </nova:instance>
Nov 14 13:20:10 user nova-compute[75258]:   </metadata>
Nov 14 13:20:10 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:20:10 user nova-compute[75258]:     <system>
Nov 14 13:20:10 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:20:10 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:20:10 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:20:10 user nova-compute[75258]:       <entry name="serial">5b541fb3-03f2-4c04-9e46-59a226840caf</entry>
Nov 14 13:20:10 user nova-compute[75258]:       <entry name="uuid">5b541fb3-03f2-4c04-9e46-59a226840caf</entry>
Nov 14 13:20:10 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:20:10 user nova-compute[75258]:     </system>
Nov 14 13:20:10 user nova-compute[75258]:   </sysinfo>
Nov 14 13:20:10 user nova-compute[75258]:   <os>
Nov 14 13:20:10 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:20:10 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:20:10 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:20:10 user nova-compute[75258]:   </os>
Nov 14 13:20:10 user nova-compute[75258]:   <features>
Nov 14 13:20:10 user nova-compute[75258]:     <acpi/>
Nov 14 13:20:10 user nova-compute[75258]:     <apic/>
Nov 14 13:20:10 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:20:10 user nova-compute[75258]:   </features>
Nov 14 13:20:10 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:20:10 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:20:10 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:20:10 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:20:10 user nova-compute[75258]:   </clock>
Nov 14 13:20:10 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:20:10 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:20:10 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:20:10 user nova-compute[75258]:   </cpu>
Nov 14 13:20:10 user nova-compute[75258]:   <devices>
Nov 14 13:20:10 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:20:10 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:20:10 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk"/>
Nov 14 13:20:10 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:20:10 user nova-compute[75258]:     </disk>
Nov 14 13:20:10 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:20:10 user nova-compute[75258]:       <mac address="fa:16:3e:ec:7e:c5"/>
Nov 14 13:20:10 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:20:10 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:20:10 user nova-compute[75258]:       <target dev="tap79d02bbe-a0"/>
Nov 14 13:20:10 user nova-compute[75258]:     </interface>
Nov 14 13:20:10 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:20:10 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/console.log" append="off"/>
Nov 14 13:20:10 user nova-compute[75258]:     </serial>
Nov 14 13:20:10 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:20:10 user nova-compute[75258]:     <video>
Nov 14 13:20:10 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:20:10 user nova-compute[75258]:     </video>
Nov 14 13:20:10 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:20:10 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:20:10 user nova-compute[75258]:     </rng>
Nov 14 13:20:10 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:20:10 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:20:10 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:20:10 user nova-compute[75258]:     </memballoon>
Nov 14 13:20:10 user nova-compute[75258]:   </devices>
Nov 14 13:20:10 user nova-compute[75258]: </domain>
Nov 14 13:20:10 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568984256',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568984256',id=45,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqqudFIc/LtSn82Mj/+EbDPNLWNBSjwhN7cRVamyAYStoInIBT+HIMtEkT6mrq8RQcSCSeMYhZYZy5WKKxs5Rya7KBW3GVpXAwUorlTPgX4VSqqfH8WosucCvyCMHRrxg==',key_name='tempest-keypair-1658443247',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-3caaof4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:20:09Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=5b541fb3-03f2-4c04-9e46-59a226840caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG os_vif [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7af30d25-6734-5a76-9c7c-45a426dda572', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79d02bbe-a0, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79d02bbe-a0, col_values=(('qos', UUID('f1bf751a-e7ff-438d-b1f5-bfff08fae585')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79d02bbe-a0, col_values=(('external_ids', {'iface-id': '79d02bbe-a080-44a1-8238-8728eeba748c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:7e:c5', 'vm-uuid': '5b541fb3-03f2-4c04-9e46-59a226840caf'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:10 user nova-compute[75258]: INFO os_vif [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0')
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No VIF found with MAC fa:16:3e:ec:7e:c5, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated VIF entry in instance network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG nova.network.neutron [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:20:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-7c10e3aa-d333-45a6-b907-03cd2348ae6a req-a0c74565-368a-4357-93f3-7a0b294aef57 service nova] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:20:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-299618fc-4648-4eeb-a3e9-b4a36ed21f19 req-fd82edbc-ce6d-4f22-b342-c82b7385a8db service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:20:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-299618fc-4648-4eeb-a3e9-b4a36ed21f19 req-fd82edbc-ce6d-4f22-b342-c82b7385a8db service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-299618fc-4648-4eeb-a3e9-b4a36ed21f19 req-fd82edbc-ce6d-4f22-b342-c82b7385a8db service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-299618fc-4648-4eeb-a3e9-b4a36ed21f19 req-fd82edbc-ce6d-4f22-b342-c82b7385a8db service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-299618fc-4648-4eeb-a3e9-b4a36ed21f19 req-fd82edbc-ce6d-4f22-b342-c82b7385a8db service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:20:12 user nova-compute[75258]: WARNING nova.compute.manager [req-299618fc-4648-4eeb-a3e9-b4a36ed21f19 req-fd82edbc-ce6d-4f22-b342-c82b7385a8db service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received unexpected event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with vm_state building and task_state spawning.
Nov 14 13:20:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:20:13 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance spawned successfully.
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:20:13 user nova-compute[75258]: INFO nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Took 5.05 seconds to spawn the instance on the hypervisor.
Nov 14 13:20:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:20:14 user nova-compute[75258]: INFO nova.compute.manager [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Took 5.59 seconds to build instance.
Nov 14 13:20:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ecf98bcd-63a5-483c-a80c-f109aa74bf1b tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.686s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-b201bb84-2e8f-474e-95f2-2df128fca14e req-1c83cca9-3e8f-493a-b44e-8817d64fd47f service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:20:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b201bb84-2e8f-474e-95f2-2df128fca14e req-1c83cca9-3e8f-493a-b44e-8817d64fd47f service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b201bb84-2e8f-474e-95f2-2df128fca14e req-1c83cca9-3e8f-493a-b44e-8817d64fd47f service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b201bb84-2e8f-474e-95f2-2df128fca14e req-1c83cca9-3e8f-493a-b44e-8817d64fd47f service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:14 user nova-compute[75258]: DEBUG nova.compute.manager [req-b201bb84-2e8f-474e-95f2-2df128fca14e req-1c83cca9-3e8f-493a-b44e-8817d64fd47f service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:20:14 user nova-compute[75258]: WARNING nova.compute.manager [req-b201bb84-2e8f-474e-95f2-2df128fca14e req-1c83cca9-3e8f-493a-b44e-8817d64fd47f service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received unexpected event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with vm_state active and task_state None.
Nov 14 13:20:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:20:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:20:45 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:20:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:20:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:20:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:20:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:20:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9048MB free_disk=25.105880737304688GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5b541fb3-03f2-4c04-9e46-59a226840caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:20:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.212s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:20:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:20:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:20:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:20:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:20:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:51 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:20:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:20:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:20:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:20:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:20:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:20:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:20:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:40 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:21:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:21:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:21:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:21:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:21:50 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:21:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:21:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:21:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9080MB free_disk=25.10531234741211GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5b541fb3-03f2-4c04-9e46-59a226840caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:21:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.205s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:21:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:21:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG nova.compute.manager [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing instance network info cache due to event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG nova.network.neutron [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG nova.network.neutron [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated VIF entry in instance network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG nova.network.neutron [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:21:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cf3a3033-b437-41a6-b860-c3f403c01265 req-6a78b9df-5513-49ce-a995-9334d413ee11 service nova] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:22:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:22:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:22:01 user nova-compute[75258]: INFO nova.compute.manager [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Shelving
Nov 14 13:22:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-b068df00-5737-4db3-9f82-538e0228be8f req-c4fa0578-afe0-45ea-bcd6-98e07c2389fd service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-unplugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:22:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b068df00-5737-4db3-9f82-538e0228be8f req-c4fa0578-afe0-45ea-bcd6-98e07c2389fd service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:22:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b068df00-5737-4db3-9f82-538e0228be8f req-c4fa0578-afe0-45ea-bcd6-98e07c2389fd service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:22:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b068df00-5737-4db3-9f82-538e0228be8f req-c4fa0578-afe0-45ea-bcd6-98e07c2389fd service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:22:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-b068df00-5737-4db3-9f82-538e0228be8f req-c4fa0578-afe0-45ea-bcd6-98e07c2389fd service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-unplugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:22:02 user nova-compute[75258]: WARNING nova.compute.manager [req-b068df00-5737-4db3-9f82-538e0228be8f req-c4fa0578-afe0-45ea-bcd6-98e07c2389fd service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received unexpected event network-vif-unplugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with vm_state active and task_state shelving.
Nov 14 13:22:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance destroyed successfully.
Nov 14 13:22:02 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Beginning cold snapshot process
Nov 14 13:22:02 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 13:22:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk /opt/stack/data/nova/instances/snapshots/tmpokxowkst/0a2f86b75fbd40cdade66f64d3b9b5af {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:22:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk /opt/stack/data/nova/instances/snapshots/tmpokxowkst/0a2f86b75fbd40cdade66f64d3b9b5af" returned: 0 in 0.477s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:22:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Snapshot extracted, beginning image upload
Nov 14 13:22:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-c6b99742-6308-45e4-8858-4717d3adc567 req-164e2e16-1c1f-4f12-94c6-678e5a9b5ee1 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:22:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6b99742-6308-45e4-8858-4717d3adc567 req-164e2e16-1c1f-4f12-94c6-678e5a9b5ee1 service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:22:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6b99742-6308-45e4-8858-4717d3adc567 req-164e2e16-1c1f-4f12-94c6-678e5a9b5ee1 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:22:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c6b99742-6308-45e4-8858-4717d3adc567 req-164e2e16-1c1f-4f12-94c6-678e5a9b5ee1 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:22:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-c6b99742-6308-45e4-8858-4717d3adc567 req-164e2e16-1c1f-4f12-94c6-678e5a9b5ee1 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:22:04 user nova-compute[75258]: WARNING nova.compute.manager [req-c6b99742-6308-45e4-8858-4717d3adc567 req-164e2e16-1c1f-4f12-94c6-678e5a9b5ee1 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received unexpected event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 13:22:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Snapshot image upload complete
Nov 14 13:22:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:22:05 user nova-compute[75258]: INFO nova.compute.manager [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Shelve offloading
Nov 14 13:22:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance destroyed successfully.
Nov 14 13:22:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:22:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:22:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:22:05 user nova-compute[75258]: DEBUG nova.network.neutron [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.network.neutron [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:22:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance destroyed successfully.
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.objects.instance [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'resources' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568984256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568984256',id=45,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqqudFIc/LtSn82Mj/+EbDPNLWNBSjwhN7cRVamyAYStoInIBT+HIMtEkT6mrq8RQcSCSeMYhZYZy5WKKxs5Rya7KBW3GVpXAwUorlTPgX4VSqqfH8WosucCvyCMHRrxg==',key_name='tempest-keypair-1658443247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-3caaof4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member',shelved_at='2023-11-14T13:22:05.744725',shelved_host='user',shelved_image_id='ac986a27-7ced-4735-9dd2-37351c82d166'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:22:03Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=5b541fb3-03f2-4c04-9e46-59a226840caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG os_vif [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79d02bbe-a0, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.compute.manager [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing instance network info cache due to event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.network.neutron [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f1bf751a-e7ff-438d-b1f5-bfff08fae585) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:22:06 user nova-compute[75258]: INFO os_vif [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0')
Nov 14 13:22:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Deleting instance files /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf_del
Nov 14 13:22:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Deletion of /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf_del complete
Nov 14 13:22:06 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Deleted allocations for instance 5b541fb3-03f2-4c04-9e46-59a226840caf
Nov 14 13:22:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.objects.instance [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:22:06 user nova-compute[75258]: DEBUG nova.objects.base [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<5b541fb3-03f2-4c04-9e46-59a226840caf> lazy-loaded attributes: resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:22:07 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:22:07 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:22:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.115s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:22:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-529d3b22-2210-4189-9a11-ad888c0e2673 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 5.261s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:22:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated VIF entry in instance network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:22:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:22:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-f33d192f-d757-4376-a19f-9f60cd572e64 req-035b9808-ff6f-43ad-884e-89ca11d05de7 service nova] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:22:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:22:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:22:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:22:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:22:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:22:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:22:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:22:47 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:22:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:22:50 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:22:50 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:22:50 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9227MB free_disk=25.08361053466797GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:22:50 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:22:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:22:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.221s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:22:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:22:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:22:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:22:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:22:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:22:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:22:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:23:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:23:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:23:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:23:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:23:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:23:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:23:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:23:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:23:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:42 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:23:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:23:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:23:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:23:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:23:51 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9238MB free_disk=25.083091735839844GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:23:51 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:23:52 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:23:52 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:23:52 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:23:52 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:23:52 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:23:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.316s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:23:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:23:54 user nova-compute[75258]: INFO nova.compute.manager [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Unshelving
Nov 14 13:23:54 user nova-compute[75258]: INFO nova.virt.block_device [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Booting with volume 77949eb6-8135-4a8d-ae5f-3e97e4547f22 at /dev/vdc
Nov 14 13:23:54 user nova-compute[75258]: DEBUG os_brick.utils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aef97a9-b88f-4bc8-9117-eaaf65e23522]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6a1b51e-725d-4b4a-93dd-662907776158]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce76eb7-bd03-4e01-9b9d-8a189578c910]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e363ac0-5998-4644-ae18-f4598f173a04]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:23:54 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:23:54 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc7321c6-62e3-4071-a8c5-9ff79a37126d]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG os_brick.utils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] <== get_connector_properties: return (143ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:23:54 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating existing volume attachment record: 904ebb91-1665-42ee-9cc9-c0684039053c {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:23:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:23:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:23:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:23:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:23:59 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'pci_requests' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:23:59 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'numa_topology' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:23:59 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:23:59 user nova-compute[75258]: INFO nova.compute.claims [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Claim successful on node user
Nov 14 13:23:59 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:23:59 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:23:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.236s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:23:59 user nova-compute[75258]: INFO nova.network.neutron [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating port 79d02bbe-a080-44a1-8238-8728eeba748c with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG nova.compute.manager [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing instance network info cache due to event network-changed-79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:24:00 user nova-compute[75258]: DEBUG nova.network.neutron [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:24:01 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Creating image(s)
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'trusted_certs' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG nova.network.neutron [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Refreshing network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG nova.objects.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<5b541fb3-03f2-4c04-9e46-59a226840caf> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "31097f6f7e78ecc9482835c0e8b002057cc9ceeb" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "31097f6f7e78ecc9482835c0e8b002057cc9ceeb" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.part --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG nova.virt.images [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] ac986a27-7ced-4735-9dd2-37351c82d166 was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.part /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated VIF entry in instance network info cache for port 79d02bbe-a080-44a1-8238-8728eeba748c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ee39b8b5-6415-4986-9910-05a22d81a26b req-4a0201b9-adf6-4e1a-8099-6ab39802b70a service nova] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.part /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.converted" returned: 0 in 0.290s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb.converted --force-share --output=json" returned: 0 in 0.165s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "31097f6f7e78ecc9482835c0e8b002057cc9ceeb" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.449s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "31097f6f7e78ecc9482835c0e8b002057cc9ceeb" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "31097f6f7e78ecc9482835c0e8b002057cc9ceeb" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb,backing_fmt=raw /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb,backing_fmt=raw /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk 1073741824" returned: 0 in 0.049s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "31097f6f7e78ecc9482835c0e8b002057cc9ceeb" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:02 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'migration_context' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:24:03 user nova-compute[75258]: DEBUG nova.objects.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<5b541fb3-03f2-4c04-9e46-59a226840caf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:24:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Rebasing disk image.
Nov 14 13:24:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae -F raw /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae -F raw /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk" returned: 0 in 2.148s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Ensure instance console log exists: /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Start _get_guest_xml network_info=[{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='290ef9a9c00fde46dc99d141c423f952',container_format='bare',created_at=2023-11-14T13:22:02Z,direct_url=<?>,disk_format='qcow2',id=ac986a27-7ced-4735-9dd2-37351c82d166,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1568984256-shelved',owner='34a39c79a82140aba72b492ccb9a7f8f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T13:22:06Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyAVYvCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '5b541fb3-03f2-4c04-9e46-59a226840caf', 'attached_at': '', 'detached_at': '', 'volume_id': '77949eb6-8135-4a8d-ae5f-3e97e4547f22', 'serial': '77949eb6-8135-4a8d-ae5f-3e97e4547f22'}, 'device_type': 'disk', 'attachment_id': '904ebb91-1665-42ee-9cc9-c0684039053c', 'boot_index': None, 'delete_on_termination': False, 'mount_device': '/dev/vdc', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:24:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:24:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='290ef9a9c00fde46dc99d141c423f952',container_format='bare',created_at=2023-11-14T13:22:02Z,direct_url=<?>,disk_format='qcow2',id=ac986a27-7ced-4735-9dd2-37351c82d166,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1568984256-shelved',owner='34a39c79a82140aba72b492ccb9a7f8f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T13:22:06Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'vcpu_model' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.objects.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<5b541fb3-03f2-4c04-9e46-59a226840caf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyAVYvCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:24:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:24:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:24:05 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1057179-d107-418a-ae42-815a9c90fb16]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:24:05 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc790dc-c88a-46d6-a295-3b79e67d82e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22] added
Nov 14 13:24:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e930621-0ac2-40a0-8478-1f6757ea9fb9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.030s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9c436f9-2200-4d80-b9ed-f7595498c188]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyAVYvCd {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SyAVYvCd" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7263fee4-ede0-46f9-8926-4eb21a8c3ae9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SyAVYvCd'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc5f60-042e-4f12-9f21-f5785d886a55]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d1b428-717e-4077-b440-2fed7e6d9646]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:24:05 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:24:05 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:24:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:24:05 user nova-compute[75258]: 
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1dd1476-ff9d-485c-9a7e-095867037579]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260]
Nov 14 13:24:05 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260] successful.
Nov 14 13:24:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f348ae83-9f3c-488f-958a-d17a19f8b699]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[00f51728-61fe-4079-b155-6a7f0f545854]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 (non-flash)
Nov 14 13:24:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 (non-flash)
Nov 14 13:24:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] HCTL ('33', '-', '-', 0) found on session 57 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9220d9b7-1e99-4141-84ef-f772179db2c2]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:24:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching for a device in session 57 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyAVYvCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.299s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] <== connect_volume: return (1301ms) {'type': 'block', 'scsi_wwn': '23966356465663562', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23966356465663562', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568984256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568984256',id=45,image_ref='ac986a27-7ced-4735-9dd2-37351c82d166',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1658443247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-3caaof4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member',shelved_at='2023-11-14T13:22:05.744725',shelved_host='user',shelved_image_id='ac986a27-7ced-4735-9dd2-37351c82d166'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=5b541fb3-03f2-4c04-9e46-59a226840caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'pci_devices' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.objects.base [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<5b541fb3-03f2-4c04-9e46-59a226840caf> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:24:06 user nova-compute[75258]:   <uuid>5b541fb3-03f2-4c04-9e46-59a226840caf</uuid>
Nov 14 13:24:06 user nova-compute[75258]:   <name>instance-0000002d</name>
Nov 14 13:24:06 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:24:06 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:24:06 user nova-compute[75258]:   <metadata>
Nov 14 13:24:06 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:24:06 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:24:06 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1568984256</nova:name>
Nov 14 13:24:06 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:24:05</nova:creationTime>
Nov 14 13:24:06 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:24:06 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:24:06 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:24:06 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:24:06 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:24:06 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:24:06 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:24:06 user nova-compute[75258]:       <nova:owner>
Nov 14 13:24:06 user nova-compute[75258]:         <nova:user uuid="6814fc9e62e247a4a44fc2314a6a672b">tempest-AttachVolumeShelveTestJSON-1949023058-project-member</nova:user>
Nov 14 13:24:06 user nova-compute[75258]:         <nova:project uuid="34a39c79a82140aba72b492ccb9a7f8f">tempest-AttachVolumeShelveTestJSON-1949023058</nova:project>
Nov 14 13:24:06 user nova-compute[75258]:       </nova:owner>
Nov 14 13:24:06 user nova-compute[75258]:       <nova:root type="image" uuid="ac986a27-7ced-4735-9dd2-37351c82d166"/>
Nov 14 13:24:06 user nova-compute[75258]:       <nova:ports>
Nov 14 13:24:06 user nova-compute[75258]:         <nova:port uuid="79d02bbe-a080-44a1-8238-8728eeba748c">
Nov 14 13:24:06 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 13:24:06 user nova-compute[75258]:         </nova:port>
Nov 14 13:24:06 user nova-compute[75258]:       </nova:ports>
Nov 14 13:24:06 user nova-compute[75258]:     </nova:instance>
Nov 14 13:24:06 user nova-compute[75258]:   </metadata>
Nov 14 13:24:06 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:24:06 user nova-compute[75258]:     <system>
Nov 14 13:24:06 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:24:06 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:24:06 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:24:06 user nova-compute[75258]:       <entry name="serial">5b541fb3-03f2-4c04-9e46-59a226840caf</entry>
Nov 14 13:24:06 user nova-compute[75258]:       <entry name="uuid">5b541fb3-03f2-4c04-9e46-59a226840caf</entry>
Nov 14 13:24:06 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:24:06 user nova-compute[75258]:     </system>
Nov 14 13:24:06 user nova-compute[75258]:   </sysinfo>
Nov 14 13:24:06 user nova-compute[75258]:   <os>
Nov 14 13:24:06 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:24:06 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:24:06 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:24:06 user nova-compute[75258]:   </os>
Nov 14 13:24:06 user nova-compute[75258]:   <features>
Nov 14 13:24:06 user nova-compute[75258]:     <acpi/>
Nov 14 13:24:06 user nova-compute[75258]:     <apic/>
Nov 14 13:24:06 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:24:06 user nova-compute[75258]:   </features>
Nov 14 13:24:06 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:24:06 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:24:06 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:24:06 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:24:06 user nova-compute[75258]:   </clock>
Nov 14 13:24:06 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:24:06 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:24:06 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:24:06 user nova-compute[75258]:   </cpu>
Nov 14 13:24:06 user nova-compute[75258]:   <devices>
Nov 14 13:24:06 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:24:06 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:24:06 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk"/>
Nov 14 13:24:06 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:24:06 user nova-compute[75258]:     </disk>
Nov 14 13:24:06 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:24:06 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:24:06 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 13:24:06 user nova-compute[75258]:       <target dev="vdc" bus="virtio"/>
Nov 14 13:24:06 user nova-compute[75258]:       <serial>77949eb6-8135-4a8d-ae5f-3e97e4547f22</serial>
Nov 14 13:24:06 user nova-compute[75258]:     </disk>
Nov 14 13:24:06 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:24:06 user nova-compute[75258]:       <mac address="fa:16:3e:ec:7e:c5"/>
Nov 14 13:24:06 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:24:06 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:24:06 user nova-compute[75258]:       <target dev="tap79d02bbe-a0"/>
Nov 14 13:24:06 user nova-compute[75258]:     </interface>
Nov 14 13:24:06 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:24:06 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/console.log" append="off"/>
Nov 14 13:24:06 user nova-compute[75258]:     </serial>
Nov 14 13:24:06 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:24:06 user nova-compute[75258]:     <video>
Nov 14 13:24:06 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:24:06 user nova-compute[75258]:     </video>
Nov 14 13:24:06 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:24:06 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:24:06 user nova-compute[75258]:     </rng>
Nov 14 13:24:06 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:24:06 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:24:06 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:24:06 user nova-compute[75258]:     </memballoon>
Nov 14 13:24:06 user nova-compute[75258]:   </devices>
Nov 14 13:24:06 user nova-compute[75258]: </domain>
Nov 14 13:24:06 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568984256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568984256',id=45,image_ref='ac986a27-7ced-4735-9dd2-37351c82d166',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1658443247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:20:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-3caaof4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member',shelved_at='2023-11-14T13:22:05.744725',shelved_host='user',shelved_image_id='ac986a27-7ced-4735-9dd2-37351c82d166'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:23:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=5b541fb3-03f2-4c04-9e46-59a226840caf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG os_vif [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7af30d25-6734-5a76-9c7c-45a426dda572', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap79d02bbe-a0, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap79d02bbe-a0, col_values=(('qos', UUID('780fc05d-d682-4045-af94-41a303b1f340')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap79d02bbe-a0, col_values=(('external_ids', {'iface-id': '79d02bbe-a080-44a1-8238-8728eeba748c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:7e:c5', 'vm-uuid': '5b541fb3-03f2-4c04-9e46-59a226840caf'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:06 user nova-compute[75258]: INFO os_vif [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0')
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No BDM found with device name vdc, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:24:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No VIF found with MAC fa:16:3e:ec:7e:c5, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-4fa76507-808f-47f3-928d-3a80e37c06ed req-f6fda05a-cfcd-43b0-a890-53313546e429 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4fa76507-808f-47f3-928d-3a80e37c06ed req-f6fda05a-cfcd-43b0-a890-53313546e429 service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4fa76507-808f-47f3-928d-3a80e37c06ed req-f6fda05a-cfcd-43b0-a890-53313546e429 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4fa76507-808f-47f3-928d-3a80e37c06ed req-f6fda05a-cfcd-43b0-a890-53313546e429 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-4fa76507-808f-47f3-928d-3a80e37c06ed req-f6fda05a-cfcd-43b0-a890-53313546e429 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:24:08 user nova-compute[75258]: WARNING nova.compute.manager [req-4fa76507-808f-47f3-928d-3a80e37c06ed req-f6fda05a-cfcd-43b0-a890-53313546e429 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received unexpected event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 13:24:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:24:10 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance spawned successfully.
Nov 14 13:24:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-eec96417-3d4c-4b5c-a213-df1465d03a3c req-701b74cb-8749-4fbb-8cf1-ee6e48336528 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eec96417-3d4c-4b5c-a213-df1465d03a3c req-701b74cb-8749-4fbb-8cf1-ee6e48336528 service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eec96417-3d4c-4b5c-a213-df1465d03a3c req-701b74cb-8749-4fbb-8cf1-ee6e48336528 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-eec96417-3d4c-4b5c-a213-df1465d03a3c req-701b74cb-8749-4fbb-8cf1-ee6e48336528 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-eec96417-3d4c-4b5c-a213-df1465d03a3c req-701b74cb-8749-4fbb-8cf1-ee6e48336528 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:24:10 user nova-compute[75258]: WARNING nova.compute.manager [req-eec96417-3d4c-4b5c-a213-df1465d03a3c req-701b74cb-8749-4fbb-8cf1-ee6e48336528 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received unexpected event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 13:24:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:24:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9e4dfd32-71bd-44a0-9738-56d7b3e120c9 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 16.559s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:24:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:24:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:24:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:24:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:24:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:24:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:24:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:24:53 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:24:53 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:24:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9068MB free_disk=25.056690216064453GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5b541fb3-03f2-4c04-9e46-59a226840caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:24:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:24:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:24:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:24:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:25:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:25:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:25:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:25:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:25:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:25:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:25:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:25:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:25:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:25:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:25:44 user nova-compute[75258]: INFO nova.compute.manager [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Detaching volume 77949eb6-8135-4a8d-ae5f-3e97e4547f22
Nov 14 13:25:44 user nova-compute[75258]: INFO nova.virt.block_device [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Attempting to driver detach volume 77949eb6-8135-4a8d-ae5f-3e97e4547f22 from mountpoint /dev/vdc
Nov 14 13:25:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Attempting to detach device vdc from instance 5b541fb3-03f2-4c04-9e46-59a226840caf from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 13:25:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:25:44 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:25:44 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:25:44 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 13:25:44 user nova-compute[75258]:   <serial>77949eb6-8135-4a8d-ae5f-3e97e4547f22</serial>
Nov 14 13:25:44 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 13:25:44 user nova-compute[75258]: </disk>
Nov 14 13:25:44 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:25:44 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully detached device vdc from instance 5b541fb3-03f2-4c04-9e46-59a226840caf from the persistent domain config.
Nov 14 13:25:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 5b541fb3-03f2-4c04-9e46-59a226840caf from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 13:25:44 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:25:44 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:25:44 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:25:44 user nova-compute[75258]:   <target dev="vdc" bus="virtio"/>
Nov 14 13:25:44 user nova-compute[75258]:   <serial>77949eb6-8135-4a8d-ae5f-3e97e4547f22</serial>
Nov 14 13:25:44 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Nov 14 13:25:44 user nova-compute[75258]: </disk>
Nov 14 13:25:44 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:25:45 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 13:25:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:25:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:25:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [{"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-5b541fb3-03f2-4c04-9e46-59a226840caf" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:25:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:25:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:25:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:25:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:25:54 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:25:54 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:25:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9083MB free_disk=25.056087493896484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 5b541fb3-03f2-4c04-9e46-59a226840caf actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:25:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.183s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:25:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:25:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:25:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:25:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Waiting for libvirt event about the detach of device vdc with device alias virtio-disk2 from instance 5b541fb3-03f2-4c04-9e46-59a226840caf is timed out.
Nov 14 13:26:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully detached device vdc from instance 5b541fb3-03f2-4c04-9e46-59a226840caf from the live domain config.
Nov 14 13:26:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SyAVYvCd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:26:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c42fdb14-e350-4ebb-8178-3dbb1274f918]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:26:05 user nova-compute[75258]: No targets found.
Nov 14 13:26:05 user nova-compute[75258]: iSNS:
Nov 14 13:26:05 user nova-compute[75258]: No targets found.
Nov 14 13:26:05 user nova-compute[75258]: STATIC:
Nov 14 13:26:05 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22
Nov 14 13:26:05 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:26:05 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:26:05 user nova-compute[75258]: FIRMWARE:
Nov 14 13:26:05 user nova-compute[75258]: No targets found.
Nov 14 13:26:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:26:05 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:26:05 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f6be6a-ff6c-480b-9a5a-52a8b3d70a70]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4839c468-08c1-4279-b367-e6268beea94e]: (4, ('tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 (non-flash)
Nov 14 13:26:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsi session list stdout=tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 (non-flash)
Nov 14 13:26:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b439f640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a37435-d352-4854-882f-7cf76b7410dc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ee726f4-0c2e-401c-af37-86f0d20c8bee]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c922f0f3-7085-490f-b40c-d9af9247d428]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.035s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[603f27f0-f43d-4442-883b-ec70d4828152]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b77bbb9a-4959-4c0c-9662-8ac55d9d656d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[26948708-9158-4b61-ba2d-80694ecebc9b]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260]
Nov 14 13:26:05 user nova-compute[75258]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22, portal: 172.16.0.220,3260] successful.
Nov 14 13:26:05 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:77949eb6-8135-4a8d-ae5f-3e97e4547f22 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dc06567-fd5a-4cff-9203-03726133ff7b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.318s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] <== disconnect_volume: return (320ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:26:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:26:06 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'flavor' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:26:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dcc3ddf-a1cd-4505-ab22-14ba8b7046e0 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.615s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:26:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:26:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:26:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:26:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:26:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:26:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:26:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:35 user nova-compute[75258]: INFO nova.compute.manager [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Terminating instance
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-fce2a883-8053-4053-9da8-77eb3f95d1b1 req-e189402b-1933-40b3-a604-956da4783ba3 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-unplugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fce2a883-8053-4053-9da8-77eb3f95d1b1 req-e189402b-1933-40b3-a604-956da4783ba3 service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fce2a883-8053-4053-9da8-77eb3f95d1b1 req-e189402b-1933-40b3-a604-956da4783ba3 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fce2a883-8053-4053-9da8-77eb3f95d1b1 req-e189402b-1933-40b3-a604-956da4783ba3 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-fce2a883-8053-4053-9da8-77eb3f95d1b1 req-e189402b-1933-40b3-a604-956da4783ba3 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-unplugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-fce2a883-8053-4053-9da8-77eb3f95d1b1 req-e189402b-1933-40b3-a604-956da4783ba3 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-unplugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Instance destroyed successfully.
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'resources' on Instance uuid 5b541fb3-03f2-4c04-9e46-59a226840caf {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:20:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1568984256',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1568984256',id=45,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLqqudFIc/LtSn82Mj/+EbDPNLWNBSjwhN7cRVamyAYStoInIBT+HIMtEkT6mrq8RQcSCSeMYhZYZy5WKKxs5Rya7KBW3GVpXAwUorlTPgX4VSqqfH8WosucCvyCMHRrxg==',key_name='tempest-keypair-1658443247',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:24:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-3caaof4u',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:24:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=5b541fb3-03f2-4c04-9e46-59a226840caf,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "79d02bbe-a080-44a1-8238-8728eeba748c", "address": "fa:16:3e:ec:7e:c5", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.107", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap79d02bbe-a0", "ovs_interfaceid": "79d02bbe-a080-44a1-8238-8728eeba748c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG os_vif [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap79d02bbe-a0, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=780fc05d-d682-4045-af94-41a303b1f340) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:26:35 user nova-compute[75258]: INFO os_vif [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ec:7e:c5,bridge_name='br-int',has_traffic_filtering=True,id=79d02bbe-a080-44a1-8238-8728eeba748c,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap79d02bbe-a0')
Nov 14 13:26:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Deleting instance files /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf_del
Nov 14 13:26:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Deletion of /opt/stack/data/nova/instances/5b541fb3-03f2-4c04-9e46-59a226840caf_del complete
Nov 14 13:26:35 user nova-compute[75258]: INFO nova.compute.manager [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Took 0.88 seconds to destroy the instance on the hypervisor.
Nov 14 13:26:35 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:26:35 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:26:36 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:26:36 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Took 0.61 seconds to deallocate network for instance.
Nov 14 13:26:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:26:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:26:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-8237a5c5-87d4-493d-af89-36705f646a43 req-a23fb116-1806-4304-92dd-b71a76095f4b service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-deleted-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:26:36 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:26:36 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:26:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.108s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:36 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Deleted allocations for instance 5b541fb3-03f2-4c04-9e46-59a226840caf
Nov 14 13:26:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b4e8d936-afa2-4fb8-9d96-bb5176aa1fdc tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.768s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-6798ed85-b708-446d-b69b-eee91693d196 req-0e6dad35-6641-49ec-a73b-525ccdade070 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:26:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6798ed85-b708-446d-b69b-eee91693d196 req-0e6dad35-6641-49ec-a73b-525ccdade070 service nova] Acquiring lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:26:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6798ed85-b708-446d-b69b-eee91693d196 req-0e6dad35-6641-49ec-a73b-525ccdade070 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:26:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6798ed85-b708-446d-b69b-eee91693d196 req-0e6dad35-6641-49ec-a73b-525ccdade070 service nova] Lock "5b541fb3-03f2-4c04-9e46-59a226840caf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-6798ed85-b708-446d-b69b-eee91693d196 req-0e6dad35-6641-49ec-a73b-525ccdade070 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] No waiting events found dispatching network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:26:37 user nova-compute[75258]: WARNING nova.compute.manager [req-6798ed85-b708-446d-b69b-eee91693d196 req-0e6dad35-6641-49ec-a73b-525ccdade070 service nova] [instance: 5b541fb3-03f2-4c04-9e46-59a226840caf] Received unexpected event network-vif-plugged-79d02bbe-a080-44a1-8238-8728eeba748c for instance with vm_state deleted and task_state None.
Nov 14 13:26:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:26:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:26:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:26:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:26:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:26:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:26:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:26:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:26:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:26:53 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:26:53 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:26:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9215MB free_disk=25.08333969116211GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:26:53 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:26:54 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:26:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:26:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.210s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:26:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:26:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:26:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:26:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:27:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:27:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:27:28 user nova-compute[75258]: INFO nova.compute.claims [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Claim successful on node user
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.198s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:27:28 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:27:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.policy [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '6814fc9e62e247a4a44fc2314a6a672b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '34a39c79a82140aba72b492ccb9a7f8f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:27:29 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Creating image(s)
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.180s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk 1073741824" returned: 0 in 0.050s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.237s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Successfully created port: 17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Checking if we can resize image /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Cannot resize image /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Ensure instance console log exists: /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Successfully updated port: 17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing instance network info cache due to event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.neutron [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance network_info: |[{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Start _get_guest_xml network_info=[{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:27:30 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:27:30 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:27:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-969633514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-969633514',id=46,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbzxh20V1rza5sn/uOAD0Md0q/kNePv3sMdFKgsNKi/v2pbdAib/RI/CF5F8rKWsA1zQWja06QwKmqRAtZA1HF2bMSic9K9cA5B3NbxnWaI0+CpJkDlsluS6ePylJSy0A==',key_name='tempest-keypair-1834543110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-mp0u27oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=83eb86c8-fdd0-4bd5-9a2e-eef53b225b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'pci_devices' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:27:30 user nova-compute[75258]:   <uuid>83eb86c8-fdd0-4bd5-9a2e-eef53b225b47</uuid>
Nov 14 13:27:30 user nova-compute[75258]:   <name>instance-0000002e</name>
Nov 14 13:27:30 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:27:30 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:27:30 user nova-compute[75258]:   <metadata>
Nov 14 13:27:30 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:27:30 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:27:30 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-969633514</nova:name>
Nov 14 13:27:30 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:27:30</nova:creationTime>
Nov 14 13:27:30 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:27:30 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:27:30 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:27:30 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:27:30 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:27:30 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:27:30 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:27:30 user nova-compute[75258]:       <nova:owner>
Nov 14 13:27:30 user nova-compute[75258]:         <nova:user uuid="6814fc9e62e247a4a44fc2314a6a672b">tempest-AttachVolumeShelveTestJSON-1949023058-project-member</nova:user>
Nov 14 13:27:30 user nova-compute[75258]:         <nova:project uuid="34a39c79a82140aba72b492ccb9a7f8f">tempest-AttachVolumeShelveTestJSON-1949023058</nova:project>
Nov 14 13:27:30 user nova-compute[75258]:       </nova:owner>
Nov 14 13:27:30 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:27:30 user nova-compute[75258]:       <nova:ports>
Nov 14 13:27:30 user nova-compute[75258]:         <nova:port uuid="17c50bb0-a8d3-4925-a570-6db4df364ea2">
Nov 14 13:27:30 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 13:27:30 user nova-compute[75258]:         </nova:port>
Nov 14 13:27:30 user nova-compute[75258]:       </nova:ports>
Nov 14 13:27:30 user nova-compute[75258]:     </nova:instance>
Nov 14 13:27:30 user nova-compute[75258]:   </metadata>
Nov 14 13:27:30 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:27:30 user nova-compute[75258]:     <system>
Nov 14 13:27:30 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:27:30 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:27:30 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:27:30 user nova-compute[75258]:       <entry name="serial">83eb86c8-fdd0-4bd5-9a2e-eef53b225b47</entry>
Nov 14 13:27:30 user nova-compute[75258]:       <entry name="uuid">83eb86c8-fdd0-4bd5-9a2e-eef53b225b47</entry>
Nov 14 13:27:30 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:27:30 user nova-compute[75258]:     </system>
Nov 14 13:27:30 user nova-compute[75258]:   </sysinfo>
Nov 14 13:27:30 user nova-compute[75258]:   <os>
Nov 14 13:27:30 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:27:30 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:27:30 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:27:30 user nova-compute[75258]:   </os>
Nov 14 13:27:30 user nova-compute[75258]:   <features>
Nov 14 13:27:30 user nova-compute[75258]:     <acpi/>
Nov 14 13:27:30 user nova-compute[75258]:     <apic/>
Nov 14 13:27:30 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:27:30 user nova-compute[75258]:   </features>
Nov 14 13:27:30 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:27:30 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:27:30 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:27:30 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:27:30 user nova-compute[75258]:   </clock>
Nov 14 13:27:30 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:27:30 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:27:30 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:27:30 user nova-compute[75258]:   </cpu>
Nov 14 13:27:30 user nova-compute[75258]:   <devices>
Nov 14 13:27:30 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:27:30 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:27:30 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk"/>
Nov 14 13:27:30 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:27:30 user nova-compute[75258]:     </disk>
Nov 14 13:27:30 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:27:30 user nova-compute[75258]:       <mac address="fa:16:3e:f7:83:24"/>
Nov 14 13:27:30 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:27:30 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:27:30 user nova-compute[75258]:       <target dev="tap17c50bb0-a8"/>
Nov 14 13:27:30 user nova-compute[75258]:     </interface>
Nov 14 13:27:30 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:27:30 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/console.log" append="off"/>
Nov 14 13:27:30 user nova-compute[75258]:     </serial>
Nov 14 13:27:30 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:27:30 user nova-compute[75258]:     <video>
Nov 14 13:27:30 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:27:30 user nova-compute[75258]:     </video>
Nov 14 13:27:30 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:27:30 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:27:30 user nova-compute[75258]:     </rng>
Nov 14 13:27:30 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:27:30 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:27:30 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:27:30 user nova-compute[75258]:     </memballoon>
Nov 14 13:27:30 user nova-compute[75258]:   </devices>
Nov 14 13:27:30 user nova-compute[75258]: </domain>
Nov 14 13:27:30 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:27:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-969633514',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-969633514',id=46,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbzxh20V1rza5sn/uOAD0Md0q/kNePv3sMdFKgsNKi/v2pbdAib/RI/CF5F8rKWsA1zQWja06QwKmqRAtZA1HF2bMSic9K9cA5B3NbxnWaI0+CpJkDlsluS6ePylJSy0A==',key_name='tempest-keypair-1834543110',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-mp0u27oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:27:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=83eb86c8-fdd0-4bd5-9a2e-eef53b225b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG os_vif [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64bb1e0c-4262-5768-af12-b2fc92a0f888', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17c50bb0-a8, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17c50bb0-a8, col_values=(('qos', UUID('db94b103-4a40-462a-804d-4e22208a3729')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17c50bb0-a8, col_values=(('external_ids', {'iface-id': '17c50bb0-a8d3-4925-a570-6db4df364ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:83:24', 'vm-uuid': '83eb86c8-fdd0-4bd5-9a2e-eef53b225b47'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:30 user nova-compute[75258]: INFO os_vif [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8')
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No VIF found with MAC fa:16:3e:f7:83:24, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated VIF entry in instance network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:27:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-defcfe6a-1b6e-4e46-9b82-2a78a5cedb74 req-72986fa2-dcd6-4752-abbd-bba48462a83c service nova] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:27:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-41431fc6-c071-43f9-87b2-8f3b9788fcb3 req-a21bb39e-4f08-4dc1-926a-638c200c62b3 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:27:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41431fc6-c071-43f9-87b2-8f3b9788fcb3 req-a21bb39e-4f08-4dc1-926a-638c200c62b3 service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41431fc6-c071-43f9-87b2-8f3b9788fcb3 req-a21bb39e-4f08-4dc1-926a-638c200c62b3 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-41431fc6-c071-43f9-87b2-8f3b9788fcb3 req-a21bb39e-4f08-4dc1-926a-638c200c62b3 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-41431fc6-c071-43f9-87b2-8f3b9788fcb3 req-a21bb39e-4f08-4dc1-926a-638c200c62b3 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:27:32 user nova-compute[75258]: WARNING nova.compute.manager [req-41431fc6-c071-43f9-87b2-8f3b9788fcb3 req-a21bb39e-4f08-4dc1-926a-638c200c62b3 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received unexpected event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with vm_state building and task_state spawning.
Nov 14 13:27:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:27:34 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance spawned successfully.
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:27:34 user nova-compute[75258]: INFO nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Took 5.03 seconds to spawn the instance on the hypervisor.
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-15bb4afc-608a-4ca4-947a-2fa0450102a8 req-2a5103b5-76f0-4b85-9707-9f3ebef10045 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-15bb4afc-608a-4ca4-947a-2fa0450102a8 req-2a5103b5-76f0-4b85-9707-9f3ebef10045 service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-15bb4afc-608a-4ca4-947a-2fa0450102a8 req-2a5103b5-76f0-4b85-9707-9f3ebef10045 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-15bb4afc-608a-4ca4-947a-2fa0450102a8 req-2a5103b5-76f0-4b85-9707-9f3ebef10045 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:34 user nova-compute[75258]: DEBUG nova.compute.manager [req-15bb4afc-608a-4ca4-947a-2fa0450102a8 req-2a5103b5-76f0-4b85-9707-9f3ebef10045 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:27:34 user nova-compute[75258]: WARNING nova.compute.manager [req-15bb4afc-608a-4ca4-947a-2fa0450102a8 req-2a5103b5-76f0-4b85-9707-9f3ebef10045 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received unexpected event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with vm_state building and task_state spawning.
Nov 14 13:27:34 user nova-compute[75258]: INFO nova.compute.manager [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Took 5.57 seconds to build instance.
Nov 14 13:27:34 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f885a163-6b36-435b-9c2d-7559ae7f8362 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 5.665s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:27:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:27:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:27:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:27:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:51 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:27:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:27:54 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:27:54 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:27:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9006MB free_disk=25.047348022460938GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:27:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.195s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:27:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:27:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:28:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:28:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:28:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:28:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:20 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:28:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:28:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:28:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:28:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:28:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:28:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:28:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:28:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4998-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:28:55 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:28:56 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:28:56 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9090MB free_disk=25.045318603515625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:28:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:28:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:29:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:29:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:29:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:29:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:29:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:29:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:29:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:19 user nova-compute[75258]: DEBUG nova.compute.manager [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:29:19 user nova-compute[75258]: DEBUG nova.compute.manager [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing instance network info cache due to event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:29:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:29:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:29:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:29:20 user nova-compute[75258]: DEBUG nova.network.neutron [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated VIF entry in instance network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:29:20 user nova-compute[75258]: DEBUG nova.network.neutron [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:29:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-431e3c79-22e7-4032-a111-191dbbf17e01 req-be60d2f6-7d10-46a9-9ece-aa4846baf89a service nova] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:29:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:29:23 user nova-compute[75258]: INFO nova.compute.manager [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Shelving
Nov 14 13:29:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-b760cc2c-6fb6-42fc-9b68-f4437ff228ed req-197000e7-6d0b-4787-b4b9-974c695d5866 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-unplugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b760cc2c-6fb6-42fc-9b68-f4437ff228ed req-197000e7-6d0b-4787-b4b9-974c695d5866 service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b760cc2c-6fb6-42fc-9b68-f4437ff228ed req-197000e7-6d0b-4787-b4b9-974c695d5866 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b760cc2c-6fb6-42fc-9b68-f4437ff228ed req-197000e7-6d0b-4787-b4b9-974c695d5866 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:29:23 user nova-compute[75258]: DEBUG nova.compute.manager [req-b760cc2c-6fb6-42fc-9b68-f4437ff228ed req-197000e7-6d0b-4787-b4b9-974c695d5866 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-unplugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:29:23 user nova-compute[75258]: WARNING nova.compute.manager [req-b760cc2c-6fb6-42fc-9b68-f4437ff228ed req-197000e7-6d0b-4787-b4b9-974c695d5866 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received unexpected event network-vif-unplugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with vm_state active and task_state shelving.
Nov 14 13:29:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance destroyed successfully.
Nov 14 13:29:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Beginning cold snapshot process
Nov 14 13:29:24 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 13:29:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk /opt/stack/data/nova/instances/snapshots/tmp0iju0epc/58acebc435b24dabba4e75f1931b0b98 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:29:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk /opt/stack/data/nova/instances/snapshots/tmp0iju0epc/58acebc435b24dabba4e75f1931b0b98" returned: 0 in 0.581s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:29:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Snapshot extracted, beginning image upload
Nov 14 13:29:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-1e467720-e5ae-4560-976d-c15f55f2f2bd req-681b49ea-aa6c-4da4-8f50-be3501e0bb3d service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:29:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1e467720-e5ae-4560-976d-c15f55f2f2bd req-681b49ea-aa6c-4da4-8f50-be3501e0bb3d service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:29:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1e467720-e5ae-4560-976d-c15f55f2f2bd req-681b49ea-aa6c-4da4-8f50-be3501e0bb3d service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:29:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1e467720-e5ae-4560-976d-c15f55f2f2bd req-681b49ea-aa6c-4da4-8f50-be3501e0bb3d service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:29:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-1e467720-e5ae-4560-976d-c15f55f2f2bd req-681b49ea-aa6c-4da4-8f50-be3501e0bb3d service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:29:25 user nova-compute[75258]: WARNING nova.compute.manager [req-1e467720-e5ae-4560-976d-c15f55f2f2bd req-681b49ea-aa6c-4da4-8f50-be3501e0bb3d service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received unexpected event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with vm_state active and task_state shelving_image_uploading.
Nov 14 13:29:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Snapshot image upload complete
Nov 14 13:29:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:29:27 user nova-compute[75258]: INFO nova.compute.manager [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Shelve offloading
Nov 14 13:29:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance destroyed successfully.
Nov 14 13:29:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:29:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:29:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:29:27 user nova-compute[75258]: DEBUG nova.network.neutron [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.network.neutron [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:29:28 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance destroyed successfully.
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.objects.instance [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'resources' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:27:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-969633514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-969633514',id=46,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbzxh20V1rza5sn/uOAD0Md0q/kNePv3sMdFKgsNKi/v2pbdAib/RI/CF5F8rKWsA1zQWja06QwKmqRAtZA1HF2bMSic9K9cA5B3NbxnWaI0+CpJkDlsluS6ePylJSy0A==',key_name='tempest-keypair-1834543110',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:27:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-mp0u27oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member',shelved_at='2023-11-14T13:29:27.377347',shelved_host='user',shelved_image_id='b28c9e93-febe-4a43-9a6f-737909ff187e'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:29:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=83eb86c8-fdd0-4bd5-9a2e-eef53b225b47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG os_vif [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17c50bb0-a8, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=db94b103-4a40-462a-804d-4e22208a3729) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing instance network info cache due to event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG nova.network.neutron [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:29:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:29:28 user nova-compute[75258]: INFO os_vif [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8')
Nov 14 13:29:28 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Deleting instance files /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47_del
Nov 14 13:29:28 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Deletion of /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47_del complete
Nov 14 13:29:29 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Deleted allocations for instance 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47
Nov 14 13:29:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG nova.objects.instance [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'numa_topology' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG nova.objects.base [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<83eb86c8-fdd0-4bd5-9a2e-eef53b225b47> lazy-loaded attributes: resources,numa_topology {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated VIF entry in instance network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG nova.network.neutron [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bd4de127-8173-4029-91fa-557ebf007cfc req-cd549d97-d691-4fe3-9d0b-99071475ac93 service nova] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.101s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:29:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-215ecd64-1dcd-4f83-a670-7572eda64739 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.120s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:29:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:29:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:54 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:29:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:29:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:29:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:29:56 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:29:56 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:29:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9203MB free_disk=25.023597717285156GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:29:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:29:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:29:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:30:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:30:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:30:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:30:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:30:28 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:30:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:30:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:30:43 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:30:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:30:53 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:30:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:30:57 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:30:57 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:30:57 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9229MB free_disk=25.023052215576172GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:30:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:30:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:30:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:30:58 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:30:58 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:30:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:30:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:30:58 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:31:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:08 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:16 user nova-compute[75258]: INFO nova.compute.manager [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Unshelving
Nov 14 13:31:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'pci_requests' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'numa_topology' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:31:16 user nova-compute[75258]: INFO nova.compute.claims [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Claim successful on node user
Nov 14 13:31:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.191s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:16 user nova-compute[75258]: INFO nova.network.neutron [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating port 17c50bb0-a8d3-4925-a570-6db4df364ea2 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Nov 14 13:31:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing instance network info cache due to event network-changed-17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:31:17 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Creating image(s)
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'trusted_certs' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.network.neutron [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Refreshing network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG nova.objects.base [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<83eb86c8-fdd0-4bd5-9a2e-eef53b225b47> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "0ab3f23a7afa797f5aafba20b40f0d41d82204d4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "0ab3f23a7afa797f5aafba20b40f0d41d82204d4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:18 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.part --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.part --force-share --output=json" returned: 0 in 0.184s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG nova.virt.images [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] b28c9e93-febe-4a43-9a6f-737909ff187e was qcow2, converting to raw {{(pid=75258) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG nova.privsep.utils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=75258) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.part /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.converted {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated VIF entry in instance network info cache for port 17c50bb0-a8d3-4925-a570-6db4df364ea2. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG nova.network.neutron [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9f9efb20-9e2c-4bc3-a1cc-8ab3b3b11698 req-5dd6562a-5efe-4500-bf6f-b9406cf7f6c8 service nova] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.part /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.converted" returned: 0 in 0.498s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.converted --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4.converted --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "0ab3f23a7afa797f5aafba20b40f0d41d82204d4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.210s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4 --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "0ab3f23a7afa797f5aafba20b40f0d41d82204d4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "0ab3f23a7afa797f5aafba20b40f0d41d82204d4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:19 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4 --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4,backing_fmt=raw /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4,backing_fmt=raw /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk 1073741824" returned: 0 in 0.049s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "0ab3f23a7afa797f5aafba20b40f0d41d82204d4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4 --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4 --force-share --output=json" returned: 0 in 0.164s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'migration_context' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG nova.objects.base [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<83eb86c8-fdd0-4bd5-9a2e-eef53b225b47> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:31:20 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Rebasing disk image.
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.179s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:20 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae -F raw /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae -F raw /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk" returned: 0 in 2.006s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Ensure instance console log exists: /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Start _get_guest_xml network_info=[{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='f608194141a9fd1b8f8c8ff0f9695bbf',container_format='bare',created_at=2023-11-14T13:29:23Z,direct_url=<?>,disk_format='qcow2',id=b28c9e93-febe-4a43-9a6f-737909ff187e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-969633514-shelved',owner='34a39c79a82140aba72b492ccb9a7f8f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:31:22 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:31:22 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='f608194141a9fd1b8f8c8ff0f9695bbf',container_format='bare',created_at=2023-11-14T13:29:23Z,direct_url=<?>,disk_format='qcow2',id=b28c9e93-febe-4a43-9a6f-737909ff187e,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-969633514-shelved',owner='34a39c79a82140aba72b492ccb9a7f8f',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-11-14T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'vcpu_model' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.objects.base [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<83eb86c8-fdd0-4bd5-9a2e-eef53b225b47> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:27:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-969633514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-969633514',id=46,image_ref='b28c9e93-febe-4a43-9a6f-737909ff187e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1834543110',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:27:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-mp0u27oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member',shelved_at='2023-11-14T13:29:27.377347',shelved_host='user',shelved_image_id='b28c9e93-febe-4a43-9a6f-737909ff187e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=83eb86c8-fdd0-4bd5-9a2e-eef53b225b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'pci_devices' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.objects.base [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Object Instance<83eb86c8-fdd0-4bd5-9a2e-eef53b225b47> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=75258) wrapper /opt/stack/nova/nova/objects/base.py:126}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:31:22 user nova-compute[75258]:   <uuid>83eb86c8-fdd0-4bd5-9a2e-eef53b225b47</uuid>
Nov 14 13:31:22 user nova-compute[75258]:   <name>instance-0000002e</name>
Nov 14 13:31:22 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:31:22 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:31:22 user nova-compute[75258]:   <metadata>
Nov 14 13:31:22 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:31:22 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:31:22 user nova-compute[75258]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-969633514</nova:name>
Nov 14 13:31:22 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:31:22</nova:creationTime>
Nov 14 13:31:22 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:31:22 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:31:22 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:31:22 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:31:22 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:31:22 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:31:22 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:31:22 user nova-compute[75258]:       <nova:owner>
Nov 14 13:31:22 user nova-compute[75258]:         <nova:user uuid="6814fc9e62e247a4a44fc2314a6a672b">tempest-AttachVolumeShelveTestJSON-1949023058-project-member</nova:user>
Nov 14 13:31:22 user nova-compute[75258]:         <nova:project uuid="34a39c79a82140aba72b492ccb9a7f8f">tempest-AttachVolumeShelveTestJSON-1949023058</nova:project>
Nov 14 13:31:22 user nova-compute[75258]:       </nova:owner>
Nov 14 13:31:22 user nova-compute[75258]:       <nova:root type="image" uuid="b28c9e93-febe-4a43-9a6f-737909ff187e"/>
Nov 14 13:31:22 user nova-compute[75258]:       <nova:ports>
Nov 14 13:31:22 user nova-compute[75258]:         <nova:port uuid="17c50bb0-a8d3-4925-a570-6db4df364ea2">
Nov 14 13:31:22 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 13:31:22 user nova-compute[75258]:         </nova:port>
Nov 14 13:31:22 user nova-compute[75258]:       </nova:ports>
Nov 14 13:31:22 user nova-compute[75258]:     </nova:instance>
Nov 14 13:31:22 user nova-compute[75258]:   </metadata>
Nov 14 13:31:22 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:31:22 user nova-compute[75258]:     <system>
Nov 14 13:31:22 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:31:22 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:31:22 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:31:22 user nova-compute[75258]:       <entry name="serial">83eb86c8-fdd0-4bd5-9a2e-eef53b225b47</entry>
Nov 14 13:31:22 user nova-compute[75258]:       <entry name="uuid">83eb86c8-fdd0-4bd5-9a2e-eef53b225b47</entry>
Nov 14 13:31:22 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:31:22 user nova-compute[75258]:     </system>
Nov 14 13:31:22 user nova-compute[75258]:   </sysinfo>
Nov 14 13:31:22 user nova-compute[75258]:   <os>
Nov 14 13:31:22 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:31:22 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:31:22 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:31:22 user nova-compute[75258]:   </os>
Nov 14 13:31:22 user nova-compute[75258]:   <features>
Nov 14 13:31:22 user nova-compute[75258]:     <acpi/>
Nov 14 13:31:22 user nova-compute[75258]:     <apic/>
Nov 14 13:31:22 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:31:22 user nova-compute[75258]:   </features>
Nov 14 13:31:22 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:31:22 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:31:22 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:31:22 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:31:22 user nova-compute[75258]:   </clock>
Nov 14 13:31:22 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:31:22 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:31:22 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:31:22 user nova-compute[75258]:   </cpu>
Nov 14 13:31:22 user nova-compute[75258]:   <devices>
Nov 14 13:31:22 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:31:22 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:31:22 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk"/>
Nov 14 13:31:22 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:31:22 user nova-compute[75258]:     </disk>
Nov 14 13:31:22 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:31:22 user nova-compute[75258]:       <mac address="fa:16:3e:f7:83:24"/>
Nov 14 13:31:22 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:31:22 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:31:22 user nova-compute[75258]:       <target dev="tap17c50bb0-a8"/>
Nov 14 13:31:22 user nova-compute[75258]:     </interface>
Nov 14 13:31:22 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:31:22 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/console.log" append="off"/>
Nov 14 13:31:22 user nova-compute[75258]:     </serial>
Nov 14 13:31:22 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:31:22 user nova-compute[75258]:     <video>
Nov 14 13:31:22 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:31:22 user nova-compute[75258]:     </video>
Nov 14 13:31:22 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:31:22 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:31:22 user nova-compute[75258]:     </rng>
Nov 14 13:31:22 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:31:22 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:31:22 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:31:22 user nova-compute[75258]:     </memballoon>
Nov 14 13:31:22 user nova-compute[75258]:   </devices>
Nov 14 13:31:22 user nova-compute[75258]: </domain>
Nov 14 13:31:22 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:27:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-969633514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-969633514',id=46,image_ref='b28c9e93-febe-4a43-9a6f-737909ff187e',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1834543110',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:27:34Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-mp0u27oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member',shelved_at='2023-11-14T13:29:27.377347',shelved_host='user',shelved_image_id='b28c9e93-febe-4a43-9a6f-737909ff187e'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:31:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=83eb86c8-fdd0-4bd5-9a2e-eef53b225b47,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG os_vif [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '64bb1e0c-4262-5768-af12-b2fc92a0f888', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap17c50bb0-a8, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap17c50bb0-a8, col_values=(('qos', UUID('8d954295-aea8-49cc-9a1a-056c68486959')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap17c50bb0-a8, col_values=(('external_ids', {'iface-id': '17c50bb0-a8d3-4925-a570-6db4df364ea2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f7:83:24', 'vm-uuid': '83eb86c8-fdd0-4bd5-9a2e-eef53b225b47'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:22 user nova-compute[75258]: INFO os_vif [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8')
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:31:22 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] No VIF found with MAC fa:16:3e:f7:83:24, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-a967b36c-9a1b-4131-9ded-74ec319e624b req-cf661bdd-4c2d-4afe-8f67-d10204c5ac6e service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a967b36c-9a1b-4131-9ded-74ec319e624b req-cf661bdd-4c2d-4afe-8f67-d10204c5ac6e service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a967b36c-9a1b-4131-9ded-74ec319e624b req-cf661bdd-4c2d-4afe-8f67-d10204c5ac6e service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a967b36c-9a1b-4131-9ded-74ec319e624b req-cf661bdd-4c2d-4afe-8f67-d10204c5ac6e service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-a967b36c-9a1b-4131-9ded-74ec319e624b req-cf661bdd-4c2d-4afe-8f67-d10204c5ac6e service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:31:24 user nova-compute[75258]: WARNING nova.compute.manager [req-a967b36c-9a1b-4131-9ded-74ec319e624b req-cf661bdd-4c2d-4afe-8f67-d10204c5ac6e service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received unexpected event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 13:31:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:31:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:31:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance spawned successfully.
Nov 14 13:31:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-e14e209d-7d9f-483a-9699-0cb799d0e7fc req-2eb78ab6-1d72-4507-b905-96d81a7e3451 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:31:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e14e209d-7d9f-483a-9699-0cb799d0e7fc req-2eb78ab6-1d72-4507-b905-96d81a7e3451 service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e14e209d-7d9f-483a-9699-0cb799d0e7fc req-2eb78ab6-1d72-4507-b905-96d81a7e3451 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e14e209d-7d9f-483a-9699-0cb799d0e7fc req-2eb78ab6-1d72-4507-b905-96d81a7e3451 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-e14e209d-7d9f-483a-9699-0cb799d0e7fc req-2eb78ab6-1d72-4507-b905-96d81a7e3451 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:31:26 user nova-compute[75258]: WARNING nova.compute.manager [req-e14e209d-7d9f-483a-9699-0cb799d0e7fc req-2eb78ab6-1d72-4507-b905-96d81a7e3451 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received unexpected event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with vm_state shelved_offloaded and task_state spawning.
Nov 14 13:31:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:31:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0d36a37b-c051-4e5f-9d2f-6290503ce9e5 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 10.418s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:31:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:31:58 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:31:58 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:31:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9127MB free_disk=24.996753692626953GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:31:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.219s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:31:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:32:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_shelved_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:32:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:32:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:32:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:32:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:32:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:32:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:32:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:32:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:32:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:32:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:56 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:32:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:32:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [{"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:32:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.190s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:33:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:33:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:33:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9129MB free_disk=24.99618911743164GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:33:00 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:33:01 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:33:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:33:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:33:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:01 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:33:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:33:06 user nova-compute[75258]: INFO nova.compute.manager [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Terminating instance
Nov 14 13:33:06 user nova-compute[75258]: DEBUG nova.compute.manager [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-09c4fcab-beb0-45ee-adc1-f7d505a0b877 req-3028164f-eb52-4eaa-af78-592c77ab183e service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-unplugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-09c4fcab-beb0-45ee-adc1-f7d505a0b877 req-3028164f-eb52-4eaa-af78-592c77ab183e service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-09c4fcab-beb0-45ee-adc1-f7d505a0b877 req-3028164f-eb52-4eaa-af78-592c77ab183e service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-09c4fcab-beb0-45ee-adc1-f7d505a0b877 req-3028164f-eb52-4eaa-af78-592c77ab183e service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-09c4fcab-beb0-45ee-adc1-f7d505a0b877 req-3028164f-eb52-4eaa-af78-592c77ab183e service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-unplugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-09c4fcab-beb0-45ee-adc1-f7d505a0b877 req-3028164f-eb52-4eaa-af78-592c77ab183e service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-unplugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Instance destroyed successfully.
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.objects.instance [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lazy-loading 'resources' on Instance uuid 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-11-14T13:27:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-969633514',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-969633514',id=46,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKbzxh20V1rza5sn/uOAD0Md0q/kNePv3sMdFKgsNKi/v2pbdAib/RI/CF5F8rKWsA1zQWja06QwKmqRAtZA1HF2bMSic9K9cA5B3NbxnWaI0+CpJkDlsluS6ePylJSy0A==',key_name='tempest-keypair-1834543110',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:31:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='34a39c79a82140aba72b492ccb9a7f8f',ramdisk_id='',reservation_id='r-mp0u27oj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-1949023058',owner_user_name='tempest-AttachVolumeShelveTestJSON-1949023058-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:31:27Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='6814fc9e62e247a4a44fc2314a6a672b',uuid=83eb86c8-fdd0-4bd5-9a2e-eef53b225b47,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converting VIF {"id": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "address": "fa:16:3e:f7:83:24", "network": {"id": "1a87637c-ca03-4e98-bd68-2c99576a5f59", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-625862186-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.162", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "34a39c79a82140aba72b492ccb9a7f8f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap17c50bb0-a8", "ovs_interfaceid": "17c50bb0-a8d3-4925-a570-6db4df364ea2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG os_vif [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap17c50bb0-a8, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8d954295-aea8-49cc-9a1a-056c68486959) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:07 user nova-compute[75258]: INFO os_vif [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f7:83:24,bridge_name='br-int',has_traffic_filtering=True,id=17c50bb0-a8d3-4925-a570-6db4df364ea2,network=Network(1a87637c-ca03-4e98-bd68-2c99576a5f59),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap17c50bb0-a8')
Nov 14 13:33:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Deleting instance files /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47_del
Nov 14 13:33:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Deletion of /opt/stack/data/nova/instances/83eb86c8-fdd0-4bd5-9a2e-eef53b225b47_del complete
Nov 14 13:33:07 user nova-compute[75258]: INFO nova.compute.manager [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Took 0.90 seconds to destroy the instance on the hypervisor.
Nov 14 13:33:07 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:33:07 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:33:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:08 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:33:08 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Took 0.82 seconds to deallocate network for instance.
Nov 14 13:33:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:33:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:33:08 user nova-compute[75258]: DEBUG nova.compute.manager [req-4cc97d61-82f1-442f-8b8d-4166eca21c94 req-41aaa324-a121-4249-a8a0-292af6c2f4ca service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-deleted-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:33:08 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:33:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:33:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.118s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:33:08 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Deleted allocations for instance 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47
Nov 14 13:33:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-c3d14c95-4d51-4ce5-afd0-1905fdb36493 tempest-AttachVolumeShelveTestJSON-1949023058 tempest-AttachVolumeShelveTestJSON-1949023058-project-member] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.016s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:33:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-b73257fb-2f54-47bf-930f-63216c6323f1 req-a9272bee-3717-422c-89b4-142f77c45337 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:33:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b73257fb-2f54-47bf-930f-63216c6323f1 req-a9272bee-3717-422c-89b4-142f77c45337 service nova] Acquiring lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:33:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b73257fb-2f54-47bf-930f-63216c6323f1 req-a9272bee-3717-422c-89b4-142f77c45337 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:33:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b73257fb-2f54-47bf-930f-63216c6323f1 req-a9272bee-3717-422c-89b4-142f77c45337 service nova] Lock "83eb86c8-fdd0-4bd5-9a2e-eef53b225b47-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:33:09 user nova-compute[75258]: DEBUG nova.compute.manager [req-b73257fb-2f54-47bf-930f-63216c6323f1 req-a9272bee-3717-422c-89b4-142f77c45337 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] No waiting events found dispatching network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:33:09 user nova-compute[75258]: WARNING nova.compute.manager [req-b73257fb-2f54-47bf-930f-63216c6323f1 req-a9272bee-3717-422c-89b4-142f77c45337 service nova] [instance: 83eb86c8-fdd0-4bd5-9a2e-eef53b225b47] Received unexpected event network-vif-plugged-17c50bb0-a8d3-4925-a570-6db4df364ea2 for instance with vm_state deleted and task_state None.
Nov 14 13:33:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:33:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:33:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:33:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:33:31 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:33:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:33:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:50 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:33:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:33:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:33:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:33:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:33:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:34:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:34:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9223MB free_disk=25.023269653320312GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:34:00 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:34:01 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:34:01 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:34:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:34:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:34:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:34:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:34:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:34:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:23 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "194076f0-faea-4a6a-845b-af3ee23eb21c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:34:35 user nova-compute[75258]: INFO nova.compute.claims [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Claim successful on node user
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.200s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:34:35 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:34:35 user nova-compute[75258]: INFO nova.virt.block_device [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Booting with volume snapshot fd866d54-d5ec-4c1f-a060-2b7fd7419844 at /dev/vda
Nov 14 13:34:35 user nova-compute[75258]: DEBUG nova.policy [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f07dfad770df4a19a3e3dcf2395627df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b95cdd314035aca38a33308cd9ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:34:36 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Successfully created port: 2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Successfully updated port: 2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquired lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received event network-changed-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Refreshing instance network info cache due to event network-changed-2e492540-7ec7-4c55-98ba-88862c2500e0. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:34:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] Acquiring lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG nova.network.neutron [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updating instance_info_cache with network_info: [{"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Releasing lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Instance network_info: |[{"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] Acquired lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Refreshing network info cache for port 2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updated VIF entry in instance network info cache for port 2e492540-7ec7-4c55-98ba-88862c2500e0. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updating instance_info_cache with network_info: [{"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:34:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-ae8136da-b210-4bd2-87a2-f04e911fa6bd req-520af232-faca-49d9-8c25-3b16a3be85cb service nova] Releasing lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:34:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG os_brick.utils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87c3161-4e14-4778-943c-fbee5eab02fe]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a1877c-4343-42b2-aa6f-d9ef132c5d63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ba833a6-40e9-422f-85f0-05be04ddcefe]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e60c76a2-6799-45c9-8f21-7badabbd51b8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:34:41 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:34:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b5ea446-7cac-4cd1-9c55-bf9bb3b548d6]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG os_brick.utils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:34:41 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updating existing volume attachment record: 421e8b69-651e-4fd0-be44-d5c178594d64 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:34:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:34:46 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Creating image(s)
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Ensure instance console log exists: /opt/stack/data/nova/instances/194076f0-faea-4a6a-845b-af3ee23eb21c/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Start _get_guest_xml network_info=[{"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOtAmFco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '194076f0-faea-4a6a-845b-af3ee23eb21c', 'attached_at': '', 'detached_at': '', 'volume_id': 'c7691482-dd5e-4530-b931-e5a093afd3c8', 'serial': 'c7691482-dd5e-4530-b931-e5a093afd3c8'}, 'device_type': 'disk', 'attachment_id': '421e8b69-651e-4fd0-be44-d5c178594d64', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:34:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:34:46 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOtAmFco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:34:46 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:34:46 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:34:46 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[83be68df-e4fa-4841-b1a2-33da58b00002]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:34:46 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f62f7e3c-addf-4510-b01e-c1a6d988f649]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8] added
Nov 14 13:34:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e875c14-3dc3-4c86-a600-62958685177a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3024ff3f-149b-48a2-8867-8f368b934a82]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOtAmFco {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v xOtAmFco" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[14a54357-3938-48ef-af38-f10391af552c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'xOtAmFco'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e8fff4b-96e1-4dd3-be53-0c0bc35a4de3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[59b7edd9-b654-4a60-9896-32da24d2926a]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:34:46 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:34:46 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:34:46 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:34:46 user nova-compute[75258]: 
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7630be00-3853-4f00-b7c6-b64f26c44182]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260]
Nov 14 13:34:46 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260] successful.
Nov 14 13:34:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[834ab21b-1de8-47ed-88b7-08518f8c294f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[347e057b-bdfb-4482-8dc5-581121195b96]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 (non-flash)
Nov 14 13:34:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 (non-flash)
Nov 14 13:34:46 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.265s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] HCTL ('33', '-', '-', 0) found on session 58 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2041555-37f4-44d4-835a-93ac4787c81f]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 58 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:34:46 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOtAmFco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.296s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== connect_volume: return (1298ms) {'type': 'block', 'scsi_wwn': '26266326661643838', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26266326661643838', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-129358788',display_name='tempest-TestVolumeBootPattern-server-129358788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-129358788',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-xsq3qmav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:34:36Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=194076f0-faea-4a6a-845b-af3ee23eb21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0c:62,bridge_name='br-int',has_traffic_filtering=True,id=2e492540-7ec7-4c55-98ba-88862c2500e0,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e492540-7e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.objects.instance [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'pci_devices' on Instance uuid 194076f0-faea-4a6a-845b-af3ee23eb21c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:34:47 user nova-compute[75258]:   <uuid>194076f0-faea-4a6a-845b-af3ee23eb21c</uuid>
Nov 14 13:34:47 user nova-compute[75258]:   <name>instance-0000002f</name>
Nov 14 13:34:47 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:34:47 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:34:47 user nova-compute[75258]:   <metadata>
Nov 14 13:34:47 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:34:47 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:34:47 user nova-compute[75258]:       <nova:name>tempest-TestVolumeBootPattern-server-129358788</nova:name>
Nov 14 13:34:47 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:34:46</nova:creationTime>
Nov 14 13:34:47 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:34:47 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:34:47 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:34:47 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:34:47 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:34:47 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:34:47 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:34:47 user nova-compute[75258]:       <nova:owner>
Nov 14 13:34:47 user nova-compute[75258]:         <nova:user uuid="f07dfad770df4a19a3e3dcf2395627df">tempest-TestVolumeBootPattern-1658752255-project-member</nova:user>
Nov 14 13:34:47 user nova-compute[75258]:         <nova:project uuid="1155b95cdd314035aca38a33308cd9ff">tempest-TestVolumeBootPattern-1658752255</nova:project>
Nov 14 13:34:47 user nova-compute[75258]:       </nova:owner>
Nov 14 13:34:47 user nova-compute[75258]:       <nova:ports>
Nov 14 13:34:47 user nova-compute[75258]:         <nova:port uuid="2e492540-7ec7-4c55-98ba-88862c2500e0">
Nov 14 13:34:47 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Nov 14 13:34:47 user nova-compute[75258]:         </nova:port>
Nov 14 13:34:47 user nova-compute[75258]:       </nova:ports>
Nov 14 13:34:47 user nova-compute[75258]:     </nova:instance>
Nov 14 13:34:47 user nova-compute[75258]:   </metadata>
Nov 14 13:34:47 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:34:47 user nova-compute[75258]:     <system>
Nov 14 13:34:47 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:34:47 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:34:47 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:34:47 user nova-compute[75258]:       <entry name="serial">194076f0-faea-4a6a-845b-af3ee23eb21c</entry>
Nov 14 13:34:47 user nova-compute[75258]:       <entry name="uuid">194076f0-faea-4a6a-845b-af3ee23eb21c</entry>
Nov 14 13:34:47 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:34:47 user nova-compute[75258]:     </system>
Nov 14 13:34:47 user nova-compute[75258]:   </sysinfo>
Nov 14 13:34:47 user nova-compute[75258]:   <os>
Nov 14 13:34:47 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:34:47 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:34:47 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:34:47 user nova-compute[75258]:   </os>
Nov 14 13:34:47 user nova-compute[75258]:   <features>
Nov 14 13:34:47 user nova-compute[75258]:     <acpi/>
Nov 14 13:34:47 user nova-compute[75258]:     <apic/>
Nov 14 13:34:47 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:34:47 user nova-compute[75258]:   </features>
Nov 14 13:34:47 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:34:47 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:34:47 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:34:47 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:34:47 user nova-compute[75258]:   </clock>
Nov 14 13:34:47 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:34:47 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:34:47 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:34:47 user nova-compute[75258]:   </cpu>
Nov 14 13:34:47 user nova-compute[75258]:   <devices>
Nov 14 13:34:47 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:34:47 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:34:47 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 13:34:47 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:34:47 user nova-compute[75258]:       <serial>c7691482-dd5e-4530-b931-e5a093afd3c8</serial>
Nov 14 13:34:47 user nova-compute[75258]:     </disk>
Nov 14 13:34:47 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:34:47 user nova-compute[75258]:       <mac address="fa:16:3e:78:0c:62"/>
Nov 14 13:34:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:34:47 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:34:47 user nova-compute[75258]:       <target dev="tap2e492540-7e"/>
Nov 14 13:34:47 user nova-compute[75258]:     </interface>
Nov 14 13:34:47 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:34:47 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/194076f0-faea-4a6a-845b-af3ee23eb21c/console.log" append="off"/>
Nov 14 13:34:47 user nova-compute[75258]:     </serial>
Nov 14 13:34:47 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:34:47 user nova-compute[75258]:     <video>
Nov 14 13:34:47 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:34:47 user nova-compute[75258]:     </video>
Nov 14 13:34:47 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:34:47 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:34:47 user nova-compute[75258]:     </rng>
Nov 14 13:34:47 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:34:47 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:34:47 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:34:47 user nova-compute[75258]:     </memballoon>
Nov 14 13:34:47 user nova-compute[75258]:   </devices>
Nov 14 13:34:47 user nova-compute[75258]: </domain>
Nov 14 13:34:47 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-129358788',display_name='tempest-TestVolumeBootPattern-server-129358788',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-129358788',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-xsq3qmav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:34:36Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=194076f0-faea-4a6a-845b-af3ee23eb21c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:0c:62,bridge_name='br-int',has_traffic_filtering=True,id=2e492540-7ec7-4c55-98ba-88862c2500e0,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e492540-7e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG os_vif [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0c:62,bridge_name='br-int',has_traffic_filtering=True,id=2e492540-7ec7-4c55-98ba-88862c2500e0,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e492540-7e') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'adf28b60-ca12-504b-9afc-db9579cb9bc5', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2e492540-7e, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2e492540-7e, col_values=(('qos', UUID('68bb8056-dd11-4e81-bea7-3633752f6e86')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2e492540-7e, col_values=(('external_ids', {'iface-id': '2e492540-7ec7-4c55-98ba-88862c2500e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:0c:62', 'vm-uuid': '194076f0-faea-4a6a-845b-af3ee23eb21c'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:47 user nova-compute[75258]: INFO os_vif [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:0c:62,bridge_name='br-int',has_traffic_filtering=True,id=2e492540-7ec7-4c55-98ba-88862c2500e0,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e492540-7e')
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:34:47 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No VIF found with MAC fa:16:3e:78:0c:62, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:34:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:48 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-20b2a1b3-bbad-4ebe-ab41-79e9feb32243 req-73f19e0a-9733-45c2-97b1-3d1da939d8b6 service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received event network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:34:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-20b2a1b3-bbad-4ebe-ab41-79e9feb32243 req-73f19e0a-9733-45c2-97b1-3d1da939d8b6 service nova] Acquiring lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:34:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-20b2a1b3-bbad-4ebe-ab41-79e9feb32243 req-73f19e0a-9733-45c2-97b1-3d1da939d8b6 service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:34:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-20b2a1b3-bbad-4ebe-ab41-79e9feb32243 req-73f19e0a-9733-45c2-97b1-3d1da939d8b6 service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:34:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-20b2a1b3-bbad-4ebe-ab41-79e9feb32243 req-73f19e0a-9733-45c2-97b1-3d1da939d8b6 service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] No waiting events found dispatching network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:34:49 user nova-compute[75258]: WARNING nova.compute.manager [req-20b2a1b3-bbad-4ebe-ab41-79e9feb32243 req-73f19e0a-9733-45c2-97b1-3d1da939d8b6 service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received unexpected event network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 for instance with vm_state building and task_state spawning.
Nov 14 13:34:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:34:50 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Instance spawned successfully.
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:34:50 user nova-compute[75258]: INFO nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Took 4.81 seconds to spawn the instance on the hypervisor.
Nov 14 13:34:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:34:50 user nova-compute[75258]: INFO nova.compute.manager [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Took 15.54 seconds to build instance.
Nov 14 13:34:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-5c7a4bc1-a23c-4c18-af27-3098ba7723c2 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.639s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:34:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-941d9d26-0e9d-4798-a829-c0cb9b579230 req-856c4466-8714-4e37-8b04-6bd1097d007a service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received event network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:34:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-941d9d26-0e9d-4798-a829-c0cb9b579230 req-856c4466-8714-4e37-8b04-6bd1097d007a service nova] Acquiring lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:34:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-941d9d26-0e9d-4798-a829-c0cb9b579230 req-856c4466-8714-4e37-8b04-6bd1097d007a service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:34:51 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-941d9d26-0e9d-4798-a829-c0cb9b579230 req-856c4466-8714-4e37-8b04-6bd1097d007a service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:34:51 user nova-compute[75258]: DEBUG nova.compute.manager [req-941d9d26-0e9d-4798-a829-c0cb9b579230 req-856c4466-8714-4e37-8b04-6bd1097d007a service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] No waiting events found dispatching network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:34:51 user nova-compute[75258]: WARNING nova.compute.manager [req-941d9d26-0e9d-4798-a829-c0cb9b579230 req-856c4466-8714-4e37-8b04-6bd1097d007a service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received unexpected event network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 for instance with vm_state active and task_state None.
Nov 14 13:34:52 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:34:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:34:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:35:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:35:00 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:35:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9127MB free_disk=25.01180648803711GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 194076f0-faea-4a6a-845b-af3ee23eb21c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:35:00 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:35:01 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:35:01 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:35:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:35:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.188s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 194076f0-faea-4a6a-845b-af3ee23eb21c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updating instance_info_cache with network_info: [{"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:35:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:35:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:35:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:35:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:35:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:35:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:35:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:35:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:35:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:35:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:35:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:36:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:36:01 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:36:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9078MB free_disk=25.011131286621094GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 194076f0-faea-4a6a-845b-af3ee23eb21c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:36:01 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:36:02 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:36:02 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:36:02 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:36:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:36:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 194076f0-faea-4a6a-845b-af3ee23eb21c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updating instance_info_cache with network_info: [{"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-194076f0-faea-4a6a-845b-af3ee23eb21c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:36:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:36:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:36:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:36:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:36:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:36:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:36:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:36:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "194076f0-faea-4a6a-845b-af3ee23eb21c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:36:26 user nova-compute[75258]: INFO nova.compute.manager [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Terminating instance
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-da1759b0-4c4c-44e4-aad9-0ec9b8d7dccb req-9267ec09-49cb-4927-88b6-72595af0cbbc service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received event network-vif-unplugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-da1759b0-4c4c-44e4-aad9-0ec9b8d7dccb req-9267ec09-49cb-4927-88b6-72595af0cbbc service nova] Acquiring lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-da1759b0-4c4c-44e4-aad9-0ec9b8d7dccb req-9267ec09-49cb-4927-88b6-72595af0cbbc service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-da1759b0-4c4c-44e4-aad9-0ec9b8d7dccb req-9267ec09-49cb-4927-88b6-72595af0cbbc service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-da1759b0-4c4c-44e4-aad9-0ec9b8d7dccb req-9267ec09-49cb-4927-88b6-72595af0cbbc service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] No waiting events found dispatching network-vif-unplugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-da1759b0-4c4c-44e4-aad9-0ec9b8d7dccb req-9267ec09-49cb-4927-88b6-72595af0cbbc service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received event network-vif-unplugged-2e492540-7ec7-4c55-98ba-88862c2500e0 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Instance destroyed successfully.
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.objects.instance [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'resources' on Instance uuid 194076f0-faea-4a6a-845b-af3ee23eb21c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:34:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-129358788',display_name='tempest-TestVolumeBootPattern-server-129358788',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-129358788',id=47,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:34:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-xsq3qmav',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:34:51Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=194076f0-faea-4a6a-845b-af3ee23eb21c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "2e492540-7ec7-4c55-98ba-88862c2500e0", "address": "fa:16:3e:78:0c:62", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2e492540-7e", "ovs_interfaceid": "2e492540-7ec7-4c55-98ba-88862c2500e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:0c:62,bridge_name='br-int',has_traffic_filtering=True,id=2e492540-7ec7-4c55-98ba-88862c2500e0,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e492540-7e') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_vif [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0c:62,bridge_name='br-int',has_traffic_filtering=True,id=2e492540-7ec7-4c55-98ba-88862c2500e0,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e492540-7e') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2e492540-7e, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=68bb8056-dd11-4e81-bea7-3633752f6e86) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:36:26 user nova-compute[75258]: INFO os_vif [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:0c:62,bridge_name='br-int',has_traffic_filtering=True,id=2e492540-7ec7-4c55-98ba-88862c2500e0,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2e492540-7e')
Nov 14 13:36:26 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'xOtAmFco', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:36:26 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[772e30a5-1c13-4670-a222-64561383c576]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:36:26 user nova-compute[75258]: No targets found.
Nov 14 13:36:26 user nova-compute[75258]: iSNS:
Nov 14 13:36:26 user nova-compute[75258]: No targets found.
Nov 14 13:36:26 user nova-compute[75258]: STATIC:
Nov 14 13:36:26 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8
Nov 14 13:36:26 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:36:26 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:36:26 user nova-compute[75258]: FIRMWARE:
Nov 14 13:36:26 user nova-compute[75258]: No targets found.
Nov 14 13:36:26 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:36:26 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:36:26 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1d9b83-35de-426e-a395-7f1e29a3e5ad]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[594bdb18-229d-4466-8d01-cf5005d4ce7d]: (4, ('tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 (non-flash)
Nov 14 13:36:26 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 (non-flash)
Nov 14 13:36:26 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c5d3250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75bc25c-f178-4a2f-806a-a11bd655d926]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee9277ea-a56c-481b-bdd6-3dc05a96a51e]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ac98fe7-fa7e-416a-bbf4-29c232f9bb31]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce660658-6082-4ba7-9ef9-1ab0e5fee55e]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e13570a1-0b98-48a6-9d1d-140cb0c91fd4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1a839c9-52fe-43a6-b542-9a334a9a1a5f]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260]
Nov 14 13:36:27 user nova-compute[75258]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8, portal: 172.16.0.220,3260] successful.
Nov 14 13:36:27 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c7691482-dd5e-4530-b931-e5a093afd3c8 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[84f7e03c-5e8a-4290-ac3f-c96ddbb287e2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.307s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== disconnect_volume: return (309ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:36:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Deleting instance files /opt/stack/data/nova/instances/194076f0-faea-4a6a-845b-af3ee23eb21c_del
Nov 14 13:36:27 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Deletion of /opt/stack/data/nova/instances/194076f0-faea-4a6a-845b-af3ee23eb21c_del complete
Nov 14 13:36:27 user nova-compute[75258]: INFO nova.compute.manager [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Took 1.15 seconds to destroy the instance on the hypervisor.
Nov 14 13:36:27 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:36:27 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:36:27 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Took 0.42 seconds to deallocate network for instance.
Nov 14 13:36:27 user nova-compute[75258]: DEBUG nova.compute.manager [req-f6eb832e-cb67-41eb-adbd-81128a715495 req-0df9e182-1d2c-4995-8b48-adf3504d3197 service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received event network-vif-deleted-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:36:28 user nova-compute[75258]: INFO nova.compute.manager [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Took 0.71 seconds to detach 1 volumes for instance.
Nov 14 13:36:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-9099f3bf-c01e-41cf-963e-1373219fe974 req-8275d2e1-ed93-4a34-887b-18fc10801e03 service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received event network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9099f3bf-c01e-41cf-963e-1373219fe974 req-8275d2e1-ed93-4a34-887b-18fc10801e03 service nova] Acquiring lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9099f3bf-c01e-41cf-963e-1373219fe974 req-8275d2e1-ed93-4a34-887b-18fc10801e03 service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9099f3bf-c01e-41cf-963e-1373219fe974 req-8275d2e1-ed93-4a34-887b-18fc10801e03 service nova] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG nova.compute.manager [req-9099f3bf-c01e-41cf-963e-1373219fe974 req-8275d2e1-ed93-4a34-887b-18fc10801e03 service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] No waiting events found dispatching network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:36:28 user nova-compute[75258]: WARNING nova.compute.manager [req-9099f3bf-c01e-41cf-963e-1373219fe974 req-8275d2e1-ed93-4a34-887b-18fc10801e03 service nova] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Received unexpected event network-vif-plugged-2e492540-7ec7-4c55-98ba-88862c2500e0 for instance with vm_state active and task_state deleting.
Nov 14 13:36:28 user nova-compute[75258]: DEBUG nova.compute.manager [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 194076f0-faea-4a6a-845b-af3ee23eb21c] Deleting volume: c7691482-dd5e-4530-b931-e5a093afd3c8 {{(pid=75258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.109s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:36:28 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Deleted allocations for instance 194076f0-faea-4a6a-845b-af3ee23eb21c
Nov 14 13:36:28 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-bd78280c-827e-4806-9e66-4eb3c3a7367b tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "194076f0-faea-4a6a-845b-af3ee23eb21c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.650s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:36:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:36:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:36:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:36:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:36:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:37:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:37:03 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9195MB free_disk=25.010345458984375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:37:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:37:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:37:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:37:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:37:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:37:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:37:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:37:25 user nova-compute[75258]: INFO nova.compute.claims [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Claim successful on node user
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.199s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:37:25 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.policy [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f07dfad770df4a19a3e3dcf2395627df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b95cdd314035aca38a33308cd9ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:37:25 user nova-compute[75258]: INFO nova.virt.block_device [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Booting with volume 305ba13a-16f5-4d81-be93-4307a872d2ba at /dev/vda
Nov 14 13:37:25 user nova-compute[75258]: DEBUG os_brick.utils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8df759b-2439-4f52-925b-6266fe4aefb3]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[61973639-793a-4bd6-965d-ad2424f00481]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[68fb4a69-d335-4169-b66f-f57875a8a0f5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31dd033-c503-47f9-8927-92cd640b85a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:37:25 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:37:25 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bc39d1d-62a3-414b-906e-0211c0435d67]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG os_brick.utils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== get_connector_properties: return (136ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:37:25 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating existing volume attachment record: 10cfa6fe-3427-452b-a949-33368bdfe55c {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Successfully created port: 6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Successfully updated port: 6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquired lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-changed-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Refreshing instance network info cache due to event network-changed-6555fa73-7445-4356-86f8-7b5779558a03. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] Acquiring lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:37:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG nova.network.neutron [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Releasing lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Instance network_info: |[{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] Acquired lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Refreshing network info cache for port 6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updated VIF entry in instance network info cache for port 6555fa73-7445-4356-86f8-7b5779558a03. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG nova.network.neutron [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:37:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-74318795-c4a1-4b50-a615-dfaca9201f27 req-f3e3cd3a-126f-4963-95e7-4b1639503dc3 service nova] Releasing lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:37:30 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Creating image(s)
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Ensure instance console log exists: /opt/stack/data/nova/instances/00733f3f-2d7a-4edd-8372-ba2d96678a0b/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Start _get_guest_xml network_info=[{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRkbtHPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '00733f3f-2d7a-4edd-8372-ba2d96678a0b', 'attached_at': '', 'detached_at': '', 'volume_id': '305ba13a-16f5-4d81-be93-4307a872d2ba', 'serial': '305ba13a-16f5-4d81-be93-4307a872d2ba'}, 'device_type': 'disk', 'attachment_id': '10cfa6fe-3427-452b-a949-33368bdfe55c', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:37:30 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:37:30 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRkbtHPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:37:30 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:37:30 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:37:30 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e746d570-4005-4aec-91fb-fd402f4e7a2f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:37:30 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[54e0cd88-619f-4081-aee8-24c383ec3efa]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba] added
Nov 14 13:37:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[785381b1-640c-45c5-b02d-f070df30760e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f6640e-b70c-4ad6-8e20-38f7562d29e8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRkbtHPK {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TRkbtHPK" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa2156c2-24bb-43d8-b9ff-3c15d11becc5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TRkbtHPK'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9d3436-0901-457b-85f6-24a6eb1e27e6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edbab67c-db8a-4056-8e0c-006be0f71655]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:37:30 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:37:30 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:37:30 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:37:30 user nova-compute[75258]: 
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6d7f4e9-af73-433f-98b6-516b3bed9b6e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260]
Nov 14 13:37:30 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260] successful.
Nov 14 13:37:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7e2250-a64e-4de6-aee7-4248b93af9aa]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[892c6d10-dae7-4158-b2b1-d78809dc8d24]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:37:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:37:30 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.251s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] HCTL ('33', '-', '-', 0) found on session 59 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9af418bb-673b-4336-90e1-04761726c26e]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 59 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:37:30 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRkbtHPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.280s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== connect_volume: return (1282ms) {'type': 'block', 'scsi_wwn': '23939316363366539', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23939316363366539', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1651199289',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1651199289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1651199289',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOb16IlKkWtXedUXbKfNrlGY9xl+pMJZgT0waV6l60LUxRxmljq54GLvRiFNbpgUsh0d61m+8D91SzEdW698nC+Gn9zr+vYq8jdidt3PG7w3X31dpT607b+S8xuEbitNQ==',key_name='tempest-keypair-1988814206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-f8lmm7rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=00733f3f-2d7a-4edd-8372-ba2d96678a0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:0d:07,bridge_name='br-int',has_traffic_filtering=True,id=6555fa73-7445-4356-86f8-7b5779558a03,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6555fa73-74') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'pci_devices' on Instance uuid 00733f3f-2d7a-4edd-8372-ba2d96678a0b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:37:31 user nova-compute[75258]:   <uuid>00733f3f-2d7a-4edd-8372-ba2d96678a0b</uuid>
Nov 14 13:37:31 user nova-compute[75258]:   <name>instance-00000030</name>
Nov 14 13:37:31 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:37:31 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:37:31 user nova-compute[75258]:   <metadata>
Nov 14 13:37:31 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:37:31 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:37:31 user nova-compute[75258]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1651199289</nova:name>
Nov 14 13:37:31 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:37:30</nova:creationTime>
Nov 14 13:37:31 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:37:31 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:37:31 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:37:31 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:37:31 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:37:31 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:37:31 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:37:31 user nova-compute[75258]:       <nova:owner>
Nov 14 13:37:31 user nova-compute[75258]:         <nova:user uuid="f07dfad770df4a19a3e3dcf2395627df">tempest-TestVolumeBootPattern-1658752255-project-member</nova:user>
Nov 14 13:37:31 user nova-compute[75258]:         <nova:project uuid="1155b95cdd314035aca38a33308cd9ff">tempest-TestVolumeBootPattern-1658752255</nova:project>
Nov 14 13:37:31 user nova-compute[75258]:       </nova:owner>
Nov 14 13:37:31 user nova-compute[75258]:       <nova:ports>
Nov 14 13:37:31 user nova-compute[75258]:         <nova:port uuid="6555fa73-7445-4356-86f8-7b5779558a03">
Nov 14 13:37:31 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Nov 14 13:37:31 user nova-compute[75258]:         </nova:port>
Nov 14 13:37:31 user nova-compute[75258]:       </nova:ports>
Nov 14 13:37:31 user nova-compute[75258]:     </nova:instance>
Nov 14 13:37:31 user nova-compute[75258]:   </metadata>
Nov 14 13:37:31 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:37:31 user nova-compute[75258]:     <system>
Nov 14 13:37:31 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:37:31 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:37:31 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:37:31 user nova-compute[75258]:       <entry name="serial">00733f3f-2d7a-4edd-8372-ba2d96678a0b</entry>
Nov 14 13:37:31 user nova-compute[75258]:       <entry name="uuid">00733f3f-2d7a-4edd-8372-ba2d96678a0b</entry>
Nov 14 13:37:31 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:37:31 user nova-compute[75258]:     </system>
Nov 14 13:37:31 user nova-compute[75258]:   </sysinfo>
Nov 14 13:37:31 user nova-compute[75258]:   <os>
Nov 14 13:37:31 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:37:31 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:37:31 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:37:31 user nova-compute[75258]:   </os>
Nov 14 13:37:31 user nova-compute[75258]:   <features>
Nov 14 13:37:31 user nova-compute[75258]:     <acpi/>
Nov 14 13:37:31 user nova-compute[75258]:     <apic/>
Nov 14 13:37:31 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:37:31 user nova-compute[75258]:   </features>
Nov 14 13:37:31 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:37:31 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:37:31 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:37:31 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:37:31 user nova-compute[75258]:   </clock>
Nov 14 13:37:31 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:37:31 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:37:31 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:37:31 user nova-compute[75258]:   </cpu>
Nov 14 13:37:31 user nova-compute[75258]:   <devices>
Nov 14 13:37:31 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:37:31 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:37:31 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 13:37:31 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:37:31 user nova-compute[75258]:       <serial>305ba13a-16f5-4d81-be93-4307a872d2ba</serial>
Nov 14 13:37:31 user nova-compute[75258]:     </disk>
Nov 14 13:37:31 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:37:31 user nova-compute[75258]:       <mac address="fa:16:3e:da:0d:07"/>
Nov 14 13:37:31 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:37:31 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:37:31 user nova-compute[75258]:       <target dev="tap6555fa73-74"/>
Nov 14 13:37:31 user nova-compute[75258]:     </interface>
Nov 14 13:37:31 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:37:31 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/00733f3f-2d7a-4edd-8372-ba2d96678a0b/console.log" append="off"/>
Nov 14 13:37:31 user nova-compute[75258]:     </serial>
Nov 14 13:37:31 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:37:31 user nova-compute[75258]:     <video>
Nov 14 13:37:31 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:37:31 user nova-compute[75258]:     </video>
Nov 14 13:37:31 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:37:31 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:37:31 user nova-compute[75258]:     </rng>
Nov 14 13:37:31 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:37:31 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:37:31 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:37:31 user nova-compute[75258]:     </memballoon>
Nov 14 13:37:31 user nova-compute[75258]:   </devices>
Nov 14 13:37:31 user nova-compute[75258]: </domain>
Nov 14 13:37:31 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1651199289',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1651199289',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1651199289',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOb16IlKkWtXedUXbKfNrlGY9xl+pMJZgT0waV6l60LUxRxmljq54GLvRiFNbpgUsh0d61m+8D91SzEdW698nC+Gn9zr+vYq8jdidt3PG7w3X31dpT607b+S8xuEbitNQ==',key_name='tempest-keypair-1988814206',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-f8lmm7rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:37:26Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=00733f3f-2d7a-4edd-8372-ba2d96678a0b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:da:0d:07,bridge_name='br-int',has_traffic_filtering=True,id=6555fa73-7445-4356-86f8-7b5779558a03,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6555fa73-74') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG os_vif [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0d:07,bridge_name='br-int',has_traffic_filtering=True,id=6555fa73-7445-4356-86f8-7b5779558a03,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6555fa73-74') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '808aa9e0-199c-565c-8780-99b1f9efd7d3', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6555fa73-74, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6555fa73-74, col_values=(('qos', UUID('ece3b1cf-88c1-43b9-99e6-e857bf0a464e')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6555fa73-74, col_values=(('external_ids', {'iface-id': '6555fa73-7445-4356-86f8-7b5779558a03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:da:0d:07', 'vm-uuid': '00733f3f-2d7a-4edd-8372-ba2d96678a0b'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:31 user nova-compute[75258]: INFO os_vif [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:da:0d:07,bridge_name='br-int',has_traffic_filtering=True,id=6555fa73-7445-4356-86f8-7b5779558a03,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6555fa73-74')
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:37:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No VIF found with MAC fa:16:3e:da:0d:07, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:32 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-6725edd8-06db-449e-8283-8b1d290a21bb req-79200843-7540-48dd-a534-65d3d976e7c3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6725edd8-06db-449e-8283-8b1d290a21bb req-79200843-7540-48dd-a534-65d3d976e7c3 service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6725edd8-06db-449e-8283-8b1d290a21bb req-79200843-7540-48dd-a534-65d3d976e7c3 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6725edd8-06db-449e-8283-8b1d290a21bb req-79200843-7540-48dd-a534-65d3d976e7c3 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG nova.compute.manager [req-6725edd8-06db-449e-8283-8b1d290a21bb req-79200843-7540-48dd-a534-65d3d976e7c3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:37:33 user nova-compute[75258]: WARNING nova.compute.manager [req-6725edd8-06db-449e-8283-8b1d290a21bb req-79200843-7540-48dd-a534-65d3d976e7c3 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received unexpected event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with vm_state building and task_state spawning.
Nov 14 13:37:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:33 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:37:34 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Instance spawned successfully.
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:37:34 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:37:35 user nova-compute[75258]: INFO nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 14 13:37:35 user nova-compute[75258]: DEBUG nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:37:35 user nova-compute[75258]: INFO nova.compute.manager [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Took 9.73 seconds to build instance.
Nov 14 13:37:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a2ba8512-b8e3-4d74-848b-376647ec1670 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.825s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:37:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-a9c8a31a-9e1d-44ac-b15a-95b4257f271d req-16eb7ef9-d30d-4158-bf0e-717b132b31f6 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:37:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a9c8a31a-9e1d-44ac-b15a-95b4257f271d req-16eb7ef9-d30d-4158-bf0e-717b132b31f6 service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:37:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a9c8a31a-9e1d-44ac-b15a-95b4257f271d req-16eb7ef9-d30d-4158-bf0e-717b132b31f6 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:37:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a9c8a31a-9e1d-44ac-b15a-95b4257f271d req-16eb7ef9-d30d-4158-bf0e-717b132b31f6 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:37:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-a9c8a31a-9e1d-44ac-b15a-95b4257f271d req-16eb7ef9-d30d-4158-bf0e-717b132b31f6 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:37:35 user nova-compute[75258]: WARNING nova.compute.manager [req-a9c8a31a-9e1d-44ac-b15a-95b4257f271d req-16eb7ef9-d30d-4158-bf0e-717b132b31f6 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received unexpected event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with vm_state active and task_state None.
Nov 14 13:37:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:37:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:37:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:37:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:37:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:37:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:37:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:38:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:38:05 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:38:05 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9084MB free_disk=25.00830078125GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:38:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 00733f3f-2d7a-4edd-8372-ba2d96678a0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.193s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:38:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 00733f3f-2d7a-4edd-8372-ba2d96678a0b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:38:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:38:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:38:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:29 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:44 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:38:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:38:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:38:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:39:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:39:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:39:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:39:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:39:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:39:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:39:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:39:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:39:07 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9104MB free_disk=25.00774383544922GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 00733f3f-2d7a-4edd-8372-ba2d96678a0b actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:39:07 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:39:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.282s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 00733f3f-2d7a-4edd-8372-ba2d96678a0b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:39:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-changed-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG nova.compute.manager [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Refreshing instance network info cache due to event network-changed-6555fa73-7445-4356-86f8-7b5779558a03. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] Acquiring lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] Acquired lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Refreshing network info cache for port 6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updated VIF entry in instance network info cache for port 6555fa73-7445-4356-86f8-7b5779558a03. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG nova.network.neutron [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9f5e0fdd-80dc-4a46-8553-092fd0f890e3 req-d3cbba3f-d792-477f-b911-6c4b8460b51c service nova] Releasing lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:39:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "4200b7a1-8f14-4dbf-b728-44a73baf726c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:39:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:39:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:39:21 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:39:21 user nova-compute[75258]: INFO nova.compute.claims [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Claim successful on node user
Nov 14 13:39:22 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:39:22 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:39:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.313s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:39:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:39:22 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:39:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:39:22 user nova-compute[75258]: DEBUG nova.network.neutron [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:39:22 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:39:22 user nova-compute[75258]: DEBUG nova.policy [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f07dfad770df4a19a3e3dcf2395627df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b95cdd314035aca38a33308cd9ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:39:22 user nova-compute[75258]: INFO nova.virt.block_device [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Booting with volume snapshot 4fd21143-2c16-4510-9c94-9773888c622c at /dev/vda
Nov 14 13:39:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Successfully created port: f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Successfully updated port: f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquired lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-changed-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Refreshing instance network info cache due to event network-changed-f231469b-1a0c-4c77-a4ee-c0b57fa036b1. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] Acquiring lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updating instance_info_cache with network_info: [{"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Releasing lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Instance network_info: |[{"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] Acquired lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:39:24 user nova-compute[75258]: DEBUG nova.network.neutron [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Refreshing network info cache for port f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:39:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updated VIF entry in instance network info cache for port f231469b-1a0c-4c77-a4ee-c0b57fa036b1. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:39:25 user nova-compute[75258]: DEBUG nova.network.neutron [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updating instance_info_cache with network_info: [{"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:39:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-350ac870-c4c1-4991-b92f-640e69b34276 req-e3f451ca-5c44-4658-816e-fa37694fd23b service nova] Releasing lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:39:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG os_brick.utils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[69e4c162-6c23-48b6-bdd6-f562acb29425]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[00c83ed9-6455-415d-a2ba-50166a400257]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6af9792-9e30-4464-8159-f94b6dd5c8e2]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b843e3cd-c774-490a-9754-4a050f02a9cc]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:39:28 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:39:28 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be3c28b-aef6-450e-afb9-a6a9ef1f7609]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG os_brick.utils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:39:28 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updating existing volume attachment record: 6df50ce2-88f5-41b3-a560-240a1edf24d4 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:39:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:39:33 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Creating image(s)
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Ensure instance console log exists: /opt/stack/data/nova/instances/4200b7a1-8f14-4dbf-b728-44a73baf726c/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Start _get_guest_xml network_info=[{"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T13:39:18Z,direct_url=<?>,disk_format='qcow2',id=5a94b622-b38c-4a2b-88a3-ec7e0ccd0ddd,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-546112215',owner='1155b95cdd314035aca38a33308cd9ff',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T13:39:19Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPXveMUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '4200b7a1-8f14-4dbf-b728-44a73baf726c', 'attached_at': '', 'detached_at': '', 'volume_id': '3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46', 'serial': '3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46'}, 'device_type': 'disk', 'attachment_id': '6df50ce2-88f5-41b3-a560-240a1edf24d4', 'boot_index': 0, 'delete_on_termination': True, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:39:33 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:39:33 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-11-14T13:39:18Z,direct_url=<?>,disk_format='qcow2',id=5a94b622-b38c-4a2b-88a3-ec7e0ccd0ddd,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-546112215',owner='1155b95cdd314035aca38a33308cd9ff',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-11-14T13:39:19Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPXveMUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:39:33 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:39:33 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:39:33 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3bc0748-e3a0-4574-bc72-17870933b411]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:39:33 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c5ce37-d734-4c9f-aa05-1b70d05f4540]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46] added
Nov 14 13:39:33 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.042s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d5e2bd-9c05-46d2-880e-3503b7c7ba64]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b6bd9cd-84d5-4bce-8f70-6c93d49bbdf2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:33 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPXveMUF {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v dPXveMUF" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[64dedc4e-974f-4822-bfdd-f3e935119984]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'dPXveMUF'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7157232-1ab2-4bfe-a56f-a8ed43cc362c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8d29f5d-b1bf-42f9-b916-656b3eca6bd6]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:39:34 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:39:34 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --login" returned: 0 in 0.049s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c098fff-915c-49d5-be5e-d4b3d090f06a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260]
Nov 14 13:39:34 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260] successful.
Nov 14 13:39:34 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c63aa5-763c-4bfb-bc1f-d1dc9cb78702]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbed4af2-6f01-4af4-9eea-2902c1611fc4]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:39:34 user nova-compute[75258]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 (non-flash)
Nov 14 13:39:34 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:39:34 user nova-compute[75258]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 (non-flash)
Nov 14 13:39:34 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.316s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef951134-d8b3-47a5-81f1-e6c6c8fd3f9a]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:39:34 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPXveMUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.348s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== connect_volume: return (1351ms) {'type': 'block', 'scsi_wwn': '26463323631333339', 'path': '/dev/sdc'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26463323631333339', 'path': '/dev/sdc'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:39:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-694968291',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-694968291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-694968291',id=49,image_ref='5a94b622-b38c-4a2b-88a3-ec7e0ccd0ddd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3zR7DgchF1GRGktbIyj2/FW9U1aKTcx/Kw+icWGbUgvPf9Hza/+WS1oVkboT0W59YHHRbAYnVVqz6O6BrC5hj+nX4Wikj3SwWbFF4K1+TOZYH01/sqB9j3Slw08cuOqw==',key_name='tempest-keypair-675344029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-2ufd4jyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1658752255',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=4200b7a1-8f14-4dbf-b728-44a73baf726c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:04:9c,bridge_name='br-int',has_traffic_filtering=True,id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf231469b-1a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.objects.instance [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'pci_devices' on Instance uuid 4200b7a1-8f14-4dbf-b728-44a73baf726c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:39:35 user nova-compute[75258]:   <uuid>4200b7a1-8f14-4dbf-b728-44a73baf726c</uuid>
Nov 14 13:39:35 user nova-compute[75258]:   <name>instance-00000031</name>
Nov 14 13:39:35 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:39:35 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:39:35 user nova-compute[75258]:   <metadata>
Nov 14 13:39:35 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:39:35 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:39:35 user nova-compute[75258]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-694968291</nova:name>
Nov 14 13:39:35 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:39:33</nova:creationTime>
Nov 14 13:39:35 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:39:35 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:39:35 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:39:35 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:39:35 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:39:35 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:39:35 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:39:35 user nova-compute[75258]:       <nova:owner>
Nov 14 13:39:35 user nova-compute[75258]:         <nova:user uuid="f07dfad770df4a19a3e3dcf2395627df">tempest-TestVolumeBootPattern-1658752255-project-member</nova:user>
Nov 14 13:39:35 user nova-compute[75258]:         <nova:project uuid="1155b95cdd314035aca38a33308cd9ff">tempest-TestVolumeBootPattern-1658752255</nova:project>
Nov 14 13:39:35 user nova-compute[75258]:       </nova:owner>
Nov 14 13:39:35 user nova-compute[75258]:       <nova:root type="image" uuid="5a94b622-b38c-4a2b-88a3-ec7e0ccd0ddd"/>
Nov 14 13:39:35 user nova-compute[75258]:       <nova:ports>
Nov 14 13:39:35 user nova-compute[75258]:         <nova:port uuid="f231469b-1a0c-4c77-a4ee-c0b57fa036b1">
Nov 14 13:39:35 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 13:39:35 user nova-compute[75258]:         </nova:port>
Nov 14 13:39:35 user nova-compute[75258]:       </nova:ports>
Nov 14 13:39:35 user nova-compute[75258]:     </nova:instance>
Nov 14 13:39:35 user nova-compute[75258]:   </metadata>
Nov 14 13:39:35 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:39:35 user nova-compute[75258]:     <system>
Nov 14 13:39:35 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:39:35 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:39:35 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:39:35 user nova-compute[75258]:       <entry name="serial">4200b7a1-8f14-4dbf-b728-44a73baf726c</entry>
Nov 14 13:39:35 user nova-compute[75258]:       <entry name="uuid">4200b7a1-8f14-4dbf-b728-44a73baf726c</entry>
Nov 14 13:39:35 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:39:35 user nova-compute[75258]:     </system>
Nov 14 13:39:35 user nova-compute[75258]:   </sysinfo>
Nov 14 13:39:35 user nova-compute[75258]:   <os>
Nov 14 13:39:35 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:39:35 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:39:35 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:39:35 user nova-compute[75258]:   </os>
Nov 14 13:39:35 user nova-compute[75258]:   <features>
Nov 14 13:39:35 user nova-compute[75258]:     <acpi/>
Nov 14 13:39:35 user nova-compute[75258]:     <apic/>
Nov 14 13:39:35 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:39:35 user nova-compute[75258]:   </features>
Nov 14 13:39:35 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:39:35 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:39:35 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:39:35 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:39:35 user nova-compute[75258]:   </clock>
Nov 14 13:39:35 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:39:35 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:39:35 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:39:35 user nova-compute[75258]:   </cpu>
Nov 14 13:39:35 user nova-compute[75258]:   <devices>
Nov 14 13:39:35 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:39:35 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:39:35 user nova-compute[75258]:       <source dev="/dev/sdc"/>
Nov 14 13:39:35 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:39:35 user nova-compute[75258]:       <serial>3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46</serial>
Nov 14 13:39:35 user nova-compute[75258]:     </disk>
Nov 14 13:39:35 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:39:35 user nova-compute[75258]:       <mac address="fa:16:3e:0f:04:9c"/>
Nov 14 13:39:35 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:39:35 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:39:35 user nova-compute[75258]:       <target dev="tapf231469b-1a"/>
Nov 14 13:39:35 user nova-compute[75258]:     </interface>
Nov 14 13:39:35 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:39:35 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/4200b7a1-8f14-4dbf-b728-44a73baf726c/console.log" append="off"/>
Nov 14 13:39:35 user nova-compute[75258]:     </serial>
Nov 14 13:39:35 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:39:35 user nova-compute[75258]:     <video>
Nov 14 13:39:35 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:39:35 user nova-compute[75258]:     </video>
Nov 14 13:39:35 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:39:35 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:39:35 user nova-compute[75258]:     </rng>
Nov 14 13:39:35 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:39:35 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:39:35 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:39:35 user nova-compute[75258]:     </memballoon>
Nov 14 13:39:35 user nova-compute[75258]:   </devices>
Nov 14 13:39:35 user nova-compute[75258]: </domain>
Nov 14 13:39:35 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:39:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-694968291',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-694968291',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-694968291',id=49,image_ref='5a94b622-b38c-4a2b-88a3-ec7e0ccd0ddd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3zR7DgchF1GRGktbIyj2/FW9U1aKTcx/Kw+icWGbUgvPf9Hza/+WS1oVkboT0W59YHHRbAYnVVqz6O6BrC5hj+nX4Wikj3SwWbFF4K1+TOZYH01/sqB9j3Slw08cuOqw==',key_name='tempest-keypair-675344029',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-2ufd4jyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1658752255',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:39:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=4200b7a1-8f14-4dbf-b728-44a73baf726c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:04:9c,bridge_name='br-int',has_traffic_filtering=True,id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf231469b-1a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG os_vif [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:04:9c,bridge_name='br-int',has_traffic_filtering=True,id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf231469b-1a') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '27a4a48c-8778-5254-b93d-2d96a9c34d5f', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf231469b-1a, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf231469b-1a, col_values=(('qos', UUID('2ad3b07d-561d-43a5-840e-80d087840c6d')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf231469b-1a, col_values=(('external_ids', {'iface-id': 'f231469b-1a0c-4c77-a4ee-c0b57fa036b1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:04:9c', 'vm-uuid': '4200b7a1-8f14-4dbf-b728-44a73baf726c'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:35 user nova-compute[75258]: INFO os_vif [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:04:9c,bridge_name='br-int',has_traffic_filtering=True,id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf231469b-1a')
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No VIF found with MAC fa:16:3e:0f:04:9c, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:39:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-c1b30681-e7d0-47fe-a2fc-bf051c896c36 req-068756fb-05d6-4493-9e8c-f7f5e837add9 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c1b30681-e7d0-47fe-a2fc-bf051c896c36 req-068756fb-05d6-4493-9e8c-f7f5e837add9 service nova] Acquiring lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c1b30681-e7d0-47fe-a2fc-bf051c896c36 req-068756fb-05d6-4493-9e8c-f7f5e837add9 service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c1b30681-e7d0-47fe-a2fc-bf051c896c36 req-068756fb-05d6-4493-9e8c-f7f5e837add9 service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:39:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-c1b30681-e7d0-47fe-a2fc-bf051c896c36 req-068756fb-05d6-4493-9e8c-f7f5e837add9 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] No waiting events found dispatching network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:39:36 user nova-compute[75258]: WARNING nova.compute.manager [req-c1b30681-e7d0-47fe-a2fc-bf051c896c36 req-068756fb-05d6-4493-9e8c-f7f5e837add9 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received unexpected event network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 for instance with vm_state building and task_state spawning.
Nov 14 13:39:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:39:38 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Instance spawned successfully.
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:39:38 user nova-compute[75258]: INFO nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Took 4.92 seconds to spawn the instance on the hypervisor.
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-fa030fbb-f959-443c-bf7e-b9ee4d27b80e req-2b6613a4-7e23-4fcb-bc29-abf33d03efed service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fa030fbb-f959-443c-bf7e-b9ee4d27b80e req-2b6613a4-7e23-4fcb-bc29-abf33d03efed service nova] Acquiring lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fa030fbb-f959-443c-bf7e-b9ee4d27b80e req-2b6613a4-7e23-4fcb-bc29-abf33d03efed service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fa030fbb-f959-443c-bf7e-b9ee4d27b80e req-2b6613a4-7e23-4fcb-bc29-abf33d03efed service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:39:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-fa030fbb-f959-443c-bf7e-b9ee4d27b80e req-2b6613a4-7e23-4fcb-bc29-abf33d03efed service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] No waiting events found dispatching network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:39:38 user nova-compute[75258]: WARNING nova.compute.manager [req-fa030fbb-f959-443c-bf7e-b9ee4d27b80e req-2b6613a4-7e23-4fcb-bc29-abf33d03efed service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received unexpected event network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 for instance with vm_state building and task_state spawning.
Nov 14 13:39:38 user nova-compute[75258]: INFO nova.compute.manager [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Took 16.83 seconds to build instance.
Nov 14 13:39:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-d5e24603-1db6-4124-bdb8-21b0ed7a17ad tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.930s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:39:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:39:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:39:57 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:40:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:40:09 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:40:09 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8946MB free_disk=24.997879028320312GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 00733f3f-2d7a-4edd-8372-ba2d96678a0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4200b7a1-8f14-4dbf-b728-44a73baf726c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:40:09 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:40:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:40:10 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:40:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:40:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.215s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:40:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 00733f3f-2d7a-4edd-8372-ba2d96678a0b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [{"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-00733f3f-2d7a-4edd-8372-ba2d96678a0b" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:40:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:40:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:40:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:40:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:40:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:40:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updating instance_info_cache with network_info: [{"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:41:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:41:11 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:41:11 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8975MB free_disk=24.997310638427734GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 00733f3f-2d7a-4edd-8372-ba2d96678a0b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 4200b7a1-8f14-4dbf-b728-44a73baf726c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:41:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.243s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:41:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-changed-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:41:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Refreshing instance network info cache due to event network-changed-f231469b-1a0c-4c77-a4ee-c0b57fa036b1. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] Acquiring lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:41:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] Acquired lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:41:12 user nova-compute[75258]: DEBUG nova.network.neutron [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Refreshing network info cache for port f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG nova.network.neutron [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updated VIF entry in instance network info cache for port f231469b-1a0c-4c77-a4ee-c0b57fa036b1. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG nova.network.neutron [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updating instance_info_cache with network_info: [{"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8cb8866b-6cfa-45a5-942c-b0f7001f78ae req-8a31f436-9f3d-490f-a62b-5f082a697af8 service nova] Releasing lock "refresh_cache-4200b7a1-8f14-4dbf-b728-44a73baf726c" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "4200b7a1-8f14-4dbf-b728-44a73baf726c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:41:13 user nova-compute[75258]: INFO nova.compute.manager [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Terminating instance
Nov 14 13:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-fd6fc898-9968-4dcb-b3a7-a3edabdccef0 req-4ffa5876-f0c9-42c5-a94c-fec01f7511f0 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-vif-unplugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd6fc898-9968-4dcb-b3a7-a3edabdccef0 req-4ffa5876-f0c9-42c5-a94c-fec01f7511f0 service nova] Acquiring lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd6fc898-9968-4dcb-b3a7-a3edabdccef0 req-4ffa5876-f0c9-42c5-a94c-fec01f7511f0 service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-fd6fc898-9968-4dcb-b3a7-a3edabdccef0 req-4ffa5876-f0c9-42c5-a94c-fec01f7511f0 service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-fd6fc898-9968-4dcb-b3a7-a3edabdccef0 req-4ffa5876-f0c9-42c5-a94c-fec01f7511f0 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] No waiting events found dispatching network-vif-unplugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:41:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-fd6fc898-9968-4dcb-b3a7-a3edabdccef0 req-4ffa5876-f0c9-42c5-a94c-fec01f7511f0 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-vif-unplugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Instance destroyed successfully.
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.objects.instance [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'resources' on Instance uuid 4200b7a1-8f14-4dbf-b728-44a73baf726c {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:39:21Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-694968291',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-694968291',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-694968291',id=49,image_ref='5a94b622-b38c-4a2b-88a3-ec7e0ccd0ddd',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3zR7DgchF1GRGktbIyj2/FW9U1aKTcx/Kw+icWGbUgvPf9Hza/+WS1oVkboT0W59YHHRbAYnVVqz6O6BrC5hj+nX4Wikj3SwWbFF4K1+TOZYH01/sqB9j3Slw08cuOqw==',key_name='tempest-keypair-675344029',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:39:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-2ufd4jyi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='reader,member',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-1658752255',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=4200b7a1-8f14-4dbf-b728-44a73baf726c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "address": "fa:16:3e:0f:04:9c", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.4", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf231469b-1a", "ovs_interfaceid": "f231469b-1a0c-4c77-a4ee-c0b57fa036b1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:04:9c,bridge_name='br-int',has_traffic_filtering=True,id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf231469b-1a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_vif [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:04:9c,bridge_name='br-int',has_traffic_filtering=True,id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf231469b-1a') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf231469b-1a, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=2ad3b07d-561d-43a5-840e-80d087840c6d) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:14 user nova-compute[75258]: INFO os_vif [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:04:9c,bridge_name='br-int',has_traffic_filtering=True,id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf231469b-1a')
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'dPXveMUF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:41:14 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e51412-473f-4a7b-ba27-5276a7a6eab7]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:41:14 user nova-compute[75258]: No targets found.
Nov 14 13:41:14 user nova-compute[75258]: iSNS:
Nov 14 13:41:14 user nova-compute[75258]: No targets found.
Nov 14 13:41:14 user nova-compute[75258]: STATIC:
Nov 14 13:41:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46
Nov 14 13:41:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:41:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:41:14 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba
Nov 14 13:41:14 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:41:14 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:41:14 user nova-compute[75258]: FIRMWARE:
Nov 14 13:41:14 user nova-compute[75258]: No targets found.
Nov 14 13:41:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:41:14 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:41:14 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7eb5daf6-2f2d-46a4-b858-0cd33e182b0a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab67065-e0fc-4431-b698-3e763abea70f]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:41:14 user nova-compute[75258]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 (non-flash)
Nov 14 13:41:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:41:14 user nova-compute[75258]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 (non-flash)
Nov 14 13:41:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b464d2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46'): ({'sdc'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Removing single pathed devices sdc {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[030a5039-e93a-467b-a370-216c149b413f]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1886bcc-03ac-406b-b6fc-d13505ddf9bc]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flushing IO for device /dev/sdc {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee871b9-a268-45a5-951e-07a3b16037bf]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.058s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0255139-5c49-4b33-a2ad-d3c920233dc0]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff816205-c4f3-4236-a7d1-ec5147587201]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5120b86c-b908-4b28-8e58-4c8e37fc96b9]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260]
Nov 14 13:41:14 user nova-compute[75258]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46, portal: 172.16.0.220,3260] successful.
Nov 14 13:41:14 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e75868-d256-470b-b46c-55d2bf354ba5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.341s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== disconnect_volume: return (342ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:41:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Deleting instance files /opt/stack/data/nova/instances/4200b7a1-8f14-4dbf-b728-44a73baf726c_del
Nov 14 13:41:14 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Deletion of /opt/stack/data/nova/instances/4200b7a1-8f14-4dbf-b728-44a73baf726c_del complete
Nov 14 13:41:14 user nova-compute[75258]: INFO nova.compute.manager [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Took 1.19 seconds to destroy the instance on the hypervisor.
Nov 14 13:41:14 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:41:14 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:41:15 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Took 0.98 seconds to deallocate network for instance.
Nov 14 13:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-e81c2ae8-a279-4652-b3ab-944c290c6a6b req-4aba06c7-7db0-4303-b44f-a2b9a9b342d8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-vif-deleted-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:41:15 user nova-compute[75258]: INFO nova.compute.manager [req-e81c2ae8-a279-4652-b3ab-944c290c6a6b req-4aba06c7-7db0-4303-b44f-a2b9a9b342d8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Neutron deleted interface f231469b-1a0c-4c77-a4ee-c0b57fa036b1; detaching it from the instance and deleting it from the info cache
Nov 14 13:41:15 user nova-compute[75258]: DEBUG nova.network.neutron [req-e81c2ae8-a279-4652-b3ab-944c290c6a6b req-4aba06c7-7db0-4303-b44f-a2b9a9b342d8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-e81c2ae8-a279-4652-b3ab-944c290c6a6b req-4aba06c7-7db0-4303-b44f-a2b9a9b342d8 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Detach interface failed, port_id=f231469b-1a0c-4c77-a4ee-c0b57fa036b1, reason: Instance 4200b7a1-8f14-4dbf-b728-44a73baf726c could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-e8db6249-85b7-4734-aa69-b7277468753f req-693bfa16-5dfd-458a-9e27-ce64d4126196 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received event network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8db6249-85b7-4734-aa69-b7277468753f req-693bfa16-5dfd-458a-9e27-ce64d4126196 service nova] Acquiring lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8db6249-85b7-4734-aa69-b7277468753f req-693bfa16-5dfd-458a-9e27-ce64d4126196 service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e8db6249-85b7-4734-aa69-b7277468753f req-693bfa16-5dfd-458a-9e27-ce64d4126196 service nova] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:41:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-e8db6249-85b7-4734-aa69-b7277468753f req-693bfa16-5dfd-458a-9e27-ce64d4126196 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] No waiting events found dispatching network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:41:15 user nova-compute[75258]: WARNING nova.compute.manager [req-e8db6249-85b7-4734-aa69-b7277468753f req-693bfa16-5dfd-458a-9e27-ce64d4126196 service nova] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Received unexpected event network-vif-plugged-f231469b-1a0c-4c77-a4ee-c0b57fa036b1 for instance with vm_state active and task_state deleting.
Nov 14 13:41:16 user nova-compute[75258]: INFO nova.compute.manager [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 13:41:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 4200b7a1-8f14-4dbf-b728-44a73baf726c] Deleting volume: 3c68a4c0-56de-4c15-95e0-b3a6ef8bcc46 {{(pid=75258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 13:41:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:41:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:41:16 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:41:16 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:41:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.134s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:41:16 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Deleted allocations for instance 4200b7a1-8f14-4dbf-b728-44a73baf726c
Nov 14 13:41:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-64a3f5d8-e462-447d-afb4-6d13f19a0e51 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "4200b7a1-8f14-4dbf-b728-44a73baf726c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.257s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:41:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:41:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:41:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:41:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:41:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:41:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:41:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:05 user nova-compute[75258]: INFO nova.compute.manager [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Terminating instance
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.compute.manager [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-6fc2d51e-9e45-4119-80e6-43f2fd72a4e7 req-5da1dc0b-93c4-4d2b-9f09-5670ceab318f service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-unplugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6fc2d51e-9e45-4119-80e6-43f2fd72a4e7 req-5da1dc0b-93c4-4d2b-9f09-5670ceab318f service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6fc2d51e-9e45-4119-80e6-43f2fd72a4e7 req-5da1dc0b-93c4-4d2b-9f09-5670ceab318f service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6fc2d51e-9e45-4119-80e6-43f2fd72a4e7 req-5da1dc0b-93c4-4d2b-9f09-5670ceab318f service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-6fc2d51e-9e45-4119-80e6-43f2fd72a4e7 req-5da1dc0b-93c4-4d2b-9f09-5670ceab318f service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-unplugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.compute.manager [req-6fc2d51e-9e45-4119-80e6-43f2fd72a4e7 req-5da1dc0b-93c4-4d2b-9f09-5670ceab318f service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-unplugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Instance destroyed successfully.
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.objects.instance [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'resources' on Instance uuid 00733f3f-2d7a-4edd-8372-ba2d96678a0b {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:37:24Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1651199289',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1651199289',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1651199289',id=48,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKOb16IlKkWtXedUXbKfNrlGY9xl+pMJZgT0waV6l60LUxRxmljq54GLvRiFNbpgUsh0d61m+8D91SzEdW698nC+Gn9zr+vYq8jdidt3PG7w3X31dpT607b+S8xuEbitNQ==',key_name='tempest-keypair-1988814206',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:37:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-f8lmm7rg',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:37:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=00733f3f-2d7a-4edd-8372-ba2d96678a0b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "6555fa73-7445-4356-86f8-7b5779558a03", "address": "fa:16:3e:da:0d:07", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.222", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap6555fa73-74", "ovs_interfaceid": "6555fa73-7445-4356-86f8-7b5779558a03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:da:0d:07,bridge_name='br-int',has_traffic_filtering=True,id=6555fa73-7445-4356-86f8-7b5779558a03,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6555fa73-74') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG os_vif [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:0d:07,bridge_name='br-int',has_traffic_filtering=True,id=6555fa73-7445-4356-86f8-7b5779558a03,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6555fa73-74') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6555fa73-74, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ece3b1cf-88c1-43b9-99e6-e857bf0a464e) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:05 user nova-compute[75258]: INFO os_vif [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:da:0d:07,bridge_name='br-int',has_traffic_filtering=True,id=6555fa73-7445-4356-86f8-7b5779558a03,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6555fa73-74')
Nov 14 13:42:05 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TRkbtHPK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:42:05 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:42:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:42:05 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[32c84b0c-d06b-43db-aca2-d7255a601b8d]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:42:06 user nova-compute[75258]: No targets found.
Nov 14 13:42:06 user nova-compute[75258]: iSNS:
Nov 14 13:42:06 user nova-compute[75258]: No targets found.
Nov 14 13:42:06 user nova-compute[75258]: STATIC:
Nov 14 13:42:06 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba
Nov 14 13:42:06 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:42:06 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:42:06 user nova-compute[75258]: FIRMWARE:
Nov 14 13:42:06 user nova-compute[75258]: No targets found.
Nov 14 13:42:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:42:06 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:42:06 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[49950ea8-7766-44e5-8307-477fcd4b2f65]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f3805e-02e8-4d0f-a533-0e94d4b923a5]: (4, ('tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:42:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba (non-flash)
Nov 14 13:42:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7bf400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.032s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6240c7c0-242e-4af2-8f8f-b9159ee361c9]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[380bcca5-e4c7-4fb3-8182-53bcd27528e1]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[be2fd842-0317-4709-ba68-696ec61bf924]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48bcce05-ae47-4896-b7ed-ad4610123bfd]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_87f157fe', '/dev/disk/by-id/scsi-23939316363366539', '/dev/disk/by-id/scsi-1SCST_BIO87f157fe-991cc6e9b0c98791') {{(pid=86014) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a0b0e27-ab62-4fe3-a189-cb918ed32030]: (4, None) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c4fde69-cc89-4445-ae96-2012de1c4564]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[395f3f09-0708-44a6-bd74-51338ca3da58]: (4, ('Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260]\nLogout of [sid: 59, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 59, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260]
Nov 14 13:42:06 user nova-compute[75258]: Logout of [sid: 59, target: iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba, portal: 172.16.0.220,3260] successful.
Nov 14 13:42:06 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:305ba13a-16f5-4d81-be93-4307a872d2ba -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[01146a72-eec9-4157-b346-97fd71a2a616]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== disconnect_volume: return (319ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:42:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Deleting instance files /opt/stack/data/nova/instances/00733f3f-2d7a-4edd-8372-ba2d96678a0b_del
Nov 14 13:42:06 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Deletion of /opt/stack/data/nova/instances/00733f3f-2d7a-4edd-8372-ba2d96678a0b_del complete
Nov 14 13:42:06 user nova-compute[75258]: INFO nova.compute.manager [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Took 1.18 seconds to destroy the instance on the hypervisor.
Nov 14 13:42:06 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-1586cf0a-96a2-44e7-a6fa-fa83dab0c2cf req-f1b94468-061c-4aec-a5db-0be83b07ca35 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-deleted-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:42:07 user nova-compute[75258]: INFO nova.compute.manager [req-1586cf0a-96a2-44e7-a6fa-fa83dab0c2cf req-f1b94468-061c-4aec-a5db-0be83b07ca35 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Neutron deleted interface 6555fa73-7445-4356-86f8-7b5779558a03; detaching it from the instance and deleting it from the info cache
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.network.neutron [req-1586cf0a-96a2-44e7-a6fa-fa83dab0c2cf req-f1b94468-061c-4aec-a5db-0be83b07ca35 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:42:07 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Took 0.74 seconds to deallocate network for instance.
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-1586cf0a-96a2-44e7-a6fa-fa83dab0c2cf req-f1b94468-061c-4aec-a5db-0be83b07ca35 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Detach interface failed, port_id=6555fa73-7445-4356-86f8-7b5779558a03, reason: Instance 00733f3f-2d7a-4edd-8372-ba2d96678a0b could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:42:07 user nova-compute[75258]: WARNING nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received unexpected event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with vm_state active and task_state deleting.
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:42:07 user nova-compute[75258]: WARNING nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received unexpected event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with vm_state active and task_state deleting.
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:42:07 user nova-compute[75258]: WARNING nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received unexpected event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with vm_state active and task_state deleting.
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-unplugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-unplugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-unplugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Acquiring lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] No waiting events found dispatching network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:42:07 user nova-compute[75258]: WARNING nova.compute.manager [req-4c44c451-d0b4-4a41-96d8-ec55275d4a19 req-97a66ce0-42a1-494a-91c0-74cac0f25601 service nova] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Received unexpected event network-vif-plugged-6555fa73-7445-4356-86f8-7b5779558a03 for instance with vm_state active and task_state deleting.
Nov 14 13:42:07 user nova-compute[75258]: INFO nova.compute.manager [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Took 0.72 seconds to detach 1 volumes for instance.
Nov 14 13:42:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: 00733f3f-2d7a-4edd-8372-ba2d96678a0b] Deleting volume: 305ba13a-16f5-4d81-be93-4307a872d2ba {{(pid=75258) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3237}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:08 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:42:08 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.142s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:08 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Deleted allocations for instance 00733f3f-2d7a-4edd-8372-ba2d96678a0b
Nov 14 13:42:08 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-816714e1-e0ec-4d9b-ad5c-82570a1b55d8 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "00733f3f-2d7a-4edd-8372-ba2d96678a0b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.044s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:42:10 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:42:10 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9141MB free_disk=24.996063232421875GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.142s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:42:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:42:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:42:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:42:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:42:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5007 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:42:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:42:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:42:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:42:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:42:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:43:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:43:02 user nova-compute[75258]: INFO nova.compute.claims [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Claim successful on node user
Nov 14 13:43:02 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.195s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:02 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:43:03 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:43:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG nova.policy [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f07dfad770df4a19a3e3dcf2395627df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b95cdd314035aca38a33308cd9ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:43:03 user nova-compute[75258]: INFO nova.virt.block_device [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Booting with volume d1d74925-6a9d-4e1b-b135-e0eb3318ace7 at /dev/vda
Nov 14 13:43:03 user nova-compute[75258]: DEBUG os_brick.utils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b47a16f-5fb1-408f-91e1-cd9149fa8fa2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d92f185-8939-4728-8a37-f02704f9df73]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a46f7486-521b-4168-9967-8e1be7dfb914]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6237ba-2c70-4844-a1db-20a7ee52171a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:43:03 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:43:03 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e92920aa-5ac6-492d-9c61-6ab65da9526d]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG os_brick.utils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== get_connector_properties: return (116ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updating existing volume attachment record: d21a0afe-1272-4e0d-b6eb-9718f5a2d7e6 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:43:03 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Successfully created port: e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Successfully updated port: e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquired lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-changed-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.compute.manager [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Refreshing instance network info cache due to event network-changed-e9207c39-cb15-4acc-b7c0-6e2713cd4914. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] Acquiring lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updating instance_info_cache with network_info: [{"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Releasing lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Instance network_info: |[{"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] Acquired lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Refreshing network info cache for port e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updated VIF entry in instance network info cache for port e9207c39-cb15-4acc-b7c0-6e2713cd4914. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG nova.network.neutron [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updating instance_info_cache with network_info: [{"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:43:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-44d0c7d5-e1a3-4638-aed1-e03ad3839c6e req-f1ca78ca-b62b-48c4-b990-ed65e80b80a5 service nova] Releasing lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:43:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:43:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:43:07 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Creating image(s)
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Ensure instance console log exists: /opt/stack/data/nova/instances/b0f5a44a-b75a-46ab-a77c-8d195054dc60/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Start _get_guest_xml network_info=[{"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b0f5a44a-b75a-46ab-a77c-8d195054dc60', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'serial': 'd1d74925-6a9d-4e1b-b135-e0eb3318ace7'}, 'device_type': 'disk', 'attachment_id': 'd21a0afe-1272-4e0d-b6eb-9718f5a2d7e6', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:43:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:43:07 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:43:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:43:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:43:07 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f328e2a2-7c4e-4493-bc28-79dcedfa557b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:43:07 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0815e2da-7831-43bc-a268-86796b53645b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7] added
Nov 14 13:43:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7ad6962-c1ec-4e6b-b652-3af93de57cfb]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.040s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fe5044-2123-4e2a-8b24-b017122accb4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REMUuKnX {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REMUuKnX" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[873d5ad1-bcae-4d31-b1b1-508bcf36395b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'REMUuKnX'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[864af988-1c2a-4378-85cb-514759149fdb]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c9382b-23e8-406d-a37d-98686b7c3d0e]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:43:07 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:43:07 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:43:07 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:43:07 user nova-compute[75258]: 
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --login" returned: 0 in 0.046s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ed58da3-bb0a-4189-bde0-3e7f8a500eae]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]
Nov 14 13:43:07 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.
Nov 14 13:43:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c2d1d6-0f46-4cf1-be20-ddab97cdcde2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[563cf0fa-ac2e-4346-8280-317ac938f22c]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:43:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:43:07 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.261s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] HCTL ('33', '-', '-', 0) found on session 61 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9abadd-e0a2-42cf-9348-6956f017c26f]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 61 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:43:07 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:43:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:08 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:43:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.292s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:43:08 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== connect_volume: return (1294ms) {'type': 'block', 'scsi_wwn': '23365383862313136', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:43:08 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365383862313136', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-405842290',display_name='tempest-TestVolumeBootPattern-server-405842290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-405842290',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-jxum1yiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:43:03Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=b0f5a44a-b75a-46ab-a77c-8d195054dc60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:2b,bridge_name='br-int',has_traffic_filtering=True,id=e9207c39-cb15-4acc-b7c0-6e2713cd4914,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9207c39-cb') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'pci_devices' on Instance uuid b0f5a44a-b75a-46ab-a77c-8d195054dc60 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:43:09 user nova-compute[75258]:   <uuid>b0f5a44a-b75a-46ab-a77c-8d195054dc60</uuid>
Nov 14 13:43:09 user nova-compute[75258]:   <name>instance-00000032</name>
Nov 14 13:43:09 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:43:09 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:43:09 user nova-compute[75258]:   <metadata>
Nov 14 13:43:09 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:43:09 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:43:09 user nova-compute[75258]:       <nova:name>tempest-TestVolumeBootPattern-server-405842290</nova:name>
Nov 14 13:43:09 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:43:07</nova:creationTime>
Nov 14 13:43:09 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:43:09 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:43:09 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:43:09 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:43:09 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:43:09 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:43:09 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:43:09 user nova-compute[75258]:       <nova:owner>
Nov 14 13:43:09 user nova-compute[75258]:         <nova:user uuid="f07dfad770df4a19a3e3dcf2395627df">tempest-TestVolumeBootPattern-1658752255-project-member</nova:user>
Nov 14 13:43:09 user nova-compute[75258]:         <nova:project uuid="1155b95cdd314035aca38a33308cd9ff">tempest-TestVolumeBootPattern-1658752255</nova:project>
Nov 14 13:43:09 user nova-compute[75258]:       </nova:owner>
Nov 14 13:43:09 user nova-compute[75258]:       <nova:ports>
Nov 14 13:43:09 user nova-compute[75258]:         <nova:port uuid="e9207c39-cb15-4acc-b7c0-6e2713cd4914">
Nov 14 13:43:09 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Nov 14 13:43:09 user nova-compute[75258]:         </nova:port>
Nov 14 13:43:09 user nova-compute[75258]:       </nova:ports>
Nov 14 13:43:09 user nova-compute[75258]:     </nova:instance>
Nov 14 13:43:09 user nova-compute[75258]:   </metadata>
Nov 14 13:43:09 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:43:09 user nova-compute[75258]:     <system>
Nov 14 13:43:09 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:43:09 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:43:09 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:43:09 user nova-compute[75258]:       <entry name="serial">b0f5a44a-b75a-46ab-a77c-8d195054dc60</entry>
Nov 14 13:43:09 user nova-compute[75258]:       <entry name="uuid">b0f5a44a-b75a-46ab-a77c-8d195054dc60</entry>
Nov 14 13:43:09 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:43:09 user nova-compute[75258]:     </system>
Nov 14 13:43:09 user nova-compute[75258]:   </sysinfo>
Nov 14 13:43:09 user nova-compute[75258]:   <os>
Nov 14 13:43:09 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:43:09 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:43:09 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:43:09 user nova-compute[75258]:   </os>
Nov 14 13:43:09 user nova-compute[75258]:   <features>
Nov 14 13:43:09 user nova-compute[75258]:     <acpi/>
Nov 14 13:43:09 user nova-compute[75258]:     <apic/>
Nov 14 13:43:09 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:43:09 user nova-compute[75258]:   </features>
Nov 14 13:43:09 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:43:09 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:43:09 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:43:09 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:43:09 user nova-compute[75258]:   </clock>
Nov 14 13:43:09 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:43:09 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:43:09 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:43:09 user nova-compute[75258]:   </cpu>
Nov 14 13:43:09 user nova-compute[75258]:   <devices>
Nov 14 13:43:09 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:43:09 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:43:09 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 13:43:09 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:43:09 user nova-compute[75258]:       <serial>d1d74925-6a9d-4e1b-b135-e0eb3318ace7</serial>
Nov 14 13:43:09 user nova-compute[75258]:     </disk>
Nov 14 13:43:09 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:43:09 user nova-compute[75258]:       <mac address="fa:16:3e:76:a6:2b"/>
Nov 14 13:43:09 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:43:09 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:43:09 user nova-compute[75258]:       <target dev="tape9207c39-cb"/>
Nov 14 13:43:09 user nova-compute[75258]:     </interface>
Nov 14 13:43:09 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:43:09 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/b0f5a44a-b75a-46ab-a77c-8d195054dc60/console.log" append="off"/>
Nov 14 13:43:09 user nova-compute[75258]:     </serial>
Nov 14 13:43:09 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:43:09 user nova-compute[75258]:     <video>
Nov 14 13:43:09 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:43:09 user nova-compute[75258]:     </video>
Nov 14 13:43:09 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:43:09 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:43:09 user nova-compute[75258]:     </rng>
Nov 14 13:43:09 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:43:09 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:43:09 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:43:09 user nova-compute[75258]:     </memballoon>
Nov 14 13:43:09 user nova-compute[75258]:   </devices>
Nov 14 13:43:09 user nova-compute[75258]: </domain>
Nov 14 13:43:09 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-405842290',display_name='tempest-TestVolumeBootPattern-server-405842290',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-405842290',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-jxum1yiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:43:03Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=b0f5a44a-b75a-46ab-a77c-8d195054dc60,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:2b,bridge_name='br-int',has_traffic_filtering=True,id=e9207c39-cb15-4acc-b7c0-6e2713cd4914,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9207c39-cb') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG os_vif [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:2b,bridge_name='br-int',has_traffic_filtering=True,id=e9207c39-cb15-4acc-b7c0-6e2713cd4914,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9207c39-cb') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '299091b8-f9a3-5aff-9d79-1ad267834a51', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape9207c39-cb, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tape9207c39-cb, col_values=(('qos', UUID('801de945-33af-4d8a-8768-2c8e2364446e')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tape9207c39-cb, col_values=(('external_ids', {'iface-id': 'e9207c39-cb15-4acc-b7c0-6e2713cd4914', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:76:a6:2b', 'vm-uuid': 'b0f5a44a-b75a-46ab-a77c-8d195054dc60'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:09 user nova-compute[75258]: INFO os_vif [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:76:a6:2b,bridge_name='br-int',has_traffic_filtering=True,id=e9207c39-cb15-4acc-b7c0-6e2713cd4914,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9207c39-cb')
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:43:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No VIF found with MAC fa:16:3e:76:a6:2b, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-cc2aaf56-e58f-4c6d-8816-2bf265053e3a req-fe6fe12b-447a-4625-9227-b5fd817dda4f service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cc2aaf56-e58f-4c6d-8816-2bf265053e3a req-fe6fe12b-447a-4625-9227-b5fd817dda4f service nova] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cc2aaf56-e58f-4c6d-8816-2bf265053e3a req-fe6fe12b-447a-4625-9227-b5fd817dda4f service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-cc2aaf56-e58f-4c6d-8816-2bf265053e3a req-fe6fe12b-447a-4625-9227-b5fd817dda4f service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG nova.compute.manager [req-cc2aaf56-e58f-4c6d-8816-2bf265053e3a req-fe6fe12b-447a-4625-9227-b5fd817dda4f service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] No waiting events found dispatching network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:43:10 user nova-compute[75258]: WARNING nova.compute.manager [req-cc2aaf56-e58f-4c6d-8816-2bf265053e3a req-fe6fe12b-447a-4625-9227-b5fd817dda4f service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received unexpected event network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 for instance with vm_state building and task_state spawning.
Nov 14 13:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Skipping network cache update for instance because it is Building. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9935}}
Nov 14 13:43:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:12 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Instance spawned successfully.
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:43:12 user nova-compute[75258]: INFO nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Took 4.89 seconds to spawn the instance on the hypervisor.
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-98a285e8-7455-4bf5-89bc-3adbcce92cbe req-8e68f12f-84da-4f5e-9eeb-d4c6a54f14b8 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-98a285e8-7455-4bf5-89bc-3adbcce92cbe req-8e68f12f-84da-4f5e-9eeb-d4c6a54f14b8 service nova] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-98a285e8-7455-4bf5-89bc-3adbcce92cbe req-8e68f12f-84da-4f5e-9eeb-d4c6a54f14b8 service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-98a285e8-7455-4bf5-89bc-3adbcce92cbe req-8e68f12f-84da-4f5e-9eeb-d4c6a54f14b8 service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.manager [req-98a285e8-7455-4bf5-89bc-3adbcce92cbe req-8e68f12f-84da-4f5e-9eeb-d4c6a54f14b8 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] No waiting events found dispatching network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:43:12 user nova-compute[75258]: WARNING nova.compute.manager [req-98a285e8-7455-4bf5-89bc-3adbcce92cbe req-8e68f12f-84da-4f5e-9eeb-d4c6a54f14b8 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received unexpected event network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 for instance with vm_state building and task_state spawning.
Nov 14 13:43:12 user nova-compute[75258]: INFO nova.compute.manager [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Took 10.17 seconds to build instance.
Nov 14 13:43:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:43:12 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9116MB free_disk=24.994007110595703GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0c541e48-d4a1-49f0-a810-b54a6d0e621e tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.278s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance b0f5a44a-b75a-46ab-a77c-8d195054dc60 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:43:12 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:43:13 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:43:13 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:43:13 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:43:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.339s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:30 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:43:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:41 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:43:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:43:55 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:43:58 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:43:58 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid b0f5a44a-b75a-46ab-a77c-8d195054dc60 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:43:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:43:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:43:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.023s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:43:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:43:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:43:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:43:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:43:59 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:44:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:07 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:09 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid b0f5a44a-b75a-46ab-a77c-8d195054dc60 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updating instance_info_cache with network_info: [{"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:44:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:44:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:44:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9038MB free_disk=24.993267059326172GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance b0f5a44a-b75a-46ab-a77c-8d195054dc60 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:44:14 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:44:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:44:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:44:15 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:44:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:44:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:44:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.261s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:44:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:44:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:44:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:44:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:44:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-changed-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Refreshing instance network info cache due to event network-changed-e9207c39-cb15-4acc-b7c0-6e2713cd4914. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] Acquiring lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] Acquired lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG nova.network.neutron [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Refreshing network info cache for port e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG nova.network.neutron [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updated VIF entry in instance network info cache for port e9207c39-cb15-4acc-b7c0-6e2713cd4914. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG nova.network.neutron [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updating instance_info_cache with network_info: [{"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8157f9bd-0021-407b-a28b-b25d5444a058 req-fe968cd3-8ad6-45df-b5ca-6aeff2297a25 service nova] Releasing lock "refresh_cache-b0f5a44a-b75a-46ab-a77c-8d195054dc60" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:44:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:44:56 user nova-compute[75258]: INFO nova.compute.manager [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Terminating instance
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.compute.manager [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-c15418dd-f5ed-427d-9023-bf60eb071f19 req-0304bdb5-5dc6-46ee-99ca-200742ea0066 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-vif-unplugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c15418dd-f5ed-427d-9023-bf60eb071f19 req-0304bdb5-5dc6-46ee-99ca-200742ea0066 service nova] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c15418dd-f5ed-427d-9023-bf60eb071f19 req-0304bdb5-5dc6-46ee-99ca-200742ea0066 service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c15418dd-f5ed-427d-9023-bf60eb071f19 req-0304bdb5-5dc6-46ee-99ca-200742ea0066 service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-c15418dd-f5ed-427d-9023-bf60eb071f19 req-0304bdb5-5dc6-46ee-99ca-200742ea0066 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] No waiting events found dispatching network-vif-unplugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.compute.manager [req-c15418dd-f5ed-427d-9023-bf60eb071f19 req-0304bdb5-5dc6-46ee-99ca-200742ea0066 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-vif-unplugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:44:56 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Instance destroyed successfully.
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.objects.instance [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'resources' on Instance uuid b0f5a44a-b75a-46ab-a77c-8d195054dc60 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:43:02Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-405842290',display_name='tempest-TestVolumeBootPattern-server-405842290',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-405842290',id=50,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:43:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-jxum1yiz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:43:13Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=b0f5a44a-b75a-46ab-a77c-8d195054dc60,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "address": "fa:16:3e:76:a6:2b", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.117", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape9207c39-cb", "ovs_interfaceid": "e9207c39-cb15-4acc-b7c0-6e2713cd4914", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:76:a6:2b,bridge_name='br-int',has_traffic_filtering=True,id=e9207c39-cb15-4acc-b7c0-6e2713cd4914,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9207c39-cb') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_vif [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:a6:2b,bridge_name='br-int',has_traffic_filtering=True,id=e9207c39-cb15-4acc-b7c0-6e2713cd4914,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9207c39-cb') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape9207c39-cb, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=801de945-33af-4d8a-8768-2c8e2364446e) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:44:56 user nova-compute[75258]: INFO os_vif [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:76:a6:2b,bridge_name='br-int',has_traffic_filtering=True,id=e9207c39-cb15-4acc-b7c0-6e2713cd4914,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape9207c39-cb')
Nov 14 13:44:56 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:44:56 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eb7c813-49bc-4396-a293-f83fc89d63e8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:44:56 user nova-compute[75258]: No targets found.
Nov 14 13:44:56 user nova-compute[75258]: iSNS:
Nov 14 13:44:56 user nova-compute[75258]: No targets found.
Nov 14 13:44:56 user nova-compute[75258]: STATIC:
Nov 14 13:44:56 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7
Nov 14 13:44:56 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:44:56 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:44:56 user nova-compute[75258]: FIRMWARE:
Nov 14 13:44:56 user nova-compute[75258]: No targets found.
Nov 14 13:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:44:56 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:44:56 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad34814-a976-492f-ba9e-510da3a7fd58]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[59550f36-ca21-4a5f-9ba4-570c71cec7b2]: (4, ('tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [61] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:44:56 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b41fe560>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b66955-4f3e-4876-aa4e-9950c1f98e83]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3133c849-e9a3-435b-9a64-ae17648cffcb]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de32e269-6c49-48bb-ac3a-52c743bb150b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:44:56 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.056s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9840b279-4eb6-4f31-913c-8657640d3b90]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e1adb5-c101-4aba-8d40-8242b2bb6b0c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8d746a-6703-45aa-b278-055d36e78f85]: (4, ('Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]\nLogout of [sid: 61, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 61, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]
Nov 14 13:44:57 user nova-compute[75258]: Logout of [sid: 61, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.
Nov 14 13:44:57 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b7c643-737e-472e-8165-ae21dbf12a8f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== disconnect_volume: return (332ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:44:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Deleting instance files /opt/stack/data/nova/instances/b0f5a44a-b75a-46ab-a77c-8d195054dc60_del
Nov 14 13:44:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Deletion of /opt/stack/data/nova/instances/b0f5a44a-b75a-46ab-a77c-8d195054dc60_del complete
Nov 14 13:44:57 user nova-compute[75258]: INFO nova.compute.manager [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Took 1.23 seconds to destroy the instance on the hypervisor.
Nov 14 13:44:57 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:44:57 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:44:57 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Took 0.62 seconds to deallocate network for instance.
Nov 14 13:44:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-82f4671b-7ded-4f17-9084-05ebd80d40bd req-ecfce7eb-8bb3-4379-9386-15c366d43ab7 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-82f4671b-7ded-4f17-9084-05ebd80d40bd req-ecfce7eb-8bb3-4379-9386-15c366d43ab7 service nova] Acquiring lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-82f4671b-7ded-4f17-9084-05ebd80d40bd req-ecfce7eb-8bb3-4379-9386-15c366d43ab7 service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-82f4671b-7ded-4f17-9084-05ebd80d40bd req-ecfce7eb-8bb3-4379-9386-15c366d43ab7 service nova] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-82f4671b-7ded-4f17-9084-05ebd80d40bd req-ecfce7eb-8bb3-4379-9386-15c366d43ab7 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] No waiting events found dispatching network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:44:58 user nova-compute[75258]: WARNING nova.compute.manager [req-82f4671b-7ded-4f17-9084-05ebd80d40bd req-ecfce7eb-8bb3-4379-9386-15c366d43ab7 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received unexpected event network-vif-plugged-e9207c39-cb15-4acc-b7c0-6e2713cd4914 for instance with vm_state active and task_state deleting.
Nov 14 13:44:58 user nova-compute[75258]: DEBUG nova.compute.manager [req-82f4671b-7ded-4f17-9084-05ebd80d40bd req-ecfce7eb-8bb3-4379-9386-15c366d43ab7 service nova] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Received event network-vif-deleted-e9207c39-cb15-4acc-b7c0-6e2713cd4914 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:44:58 user nova-compute[75258]: INFO nova.compute.manager [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: b0f5a44a-b75a-46ab-a77c-8d195054dc60] Took 0.75 seconds to detach 1 volumes for instance.
Nov 14 13:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.137s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:44:58 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Deleted allocations for instance b0f5a44a-b75a-46ab-a77c-8d195054dc60
Nov 14 13:44:58 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-620d8668-29ed-4bc6-be11-839f1e512753 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "b0f5a44a-b75a-46ab-a77c-8d195054dc60" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.951s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:00 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:08 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:10 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:45:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:45:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:45:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:45:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:45:14 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:45:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9166MB free_disk=24.99245834350586GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:45:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.169s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:45:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:43 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:45:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "e8915914-b516-4422-8cb0-5ff9bc468f3a" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:45:47 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:45:48 user nova-compute[75258]: INFO nova.compute.claims [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Claim successful on node user
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.225s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.network.neutron [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:45:48 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:45:48 user nova-compute[75258]: INFO nova.virt.block_device [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Booting with volume d1d74925-6a9d-4e1b-b135-e0eb3318ace7 at /dev/vda
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.policy [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f07dfad770df4a19a3e3dcf2395627df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b95cdd314035aca38a33308cd9ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG os_brick.utils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e523b6b-5f5e-49c3-b29f-90a3b50f362a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b528df5-0e4a-45f5-ae3d-ca39278bdbd0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3baa3138-02c8-4bdc-af16-a0f4e4a50787]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1925b2c3-e682-4ed1-a1f3-522b59228323]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:45:48 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:45:48 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f780fe-ca75-4b35-b1e7-8b6de72eabb9]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG os_brick.utils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:45:48 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating existing volume attachment record: 5bd9f489-b356-47b7-8a96-83f956db3051 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Successfully created port: 2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Successfully updated port: 2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-changed-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG nova.compute.manager [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Refreshing instance network info cache due to event network-changed-2a4588df-a898-4308-bafe-4414881c3e4c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:45:49 user nova-compute[75258]: DEBUG nova.network.neutron [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG nova.network.neutron [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Instance network_info: |[{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Refreshing network info cache for port 2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updated VIF entry in instance network info cache for port 2a4588df-a898-4308-bafe-4414881c3e4c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG nova.network.neutron [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:45:50 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bec00cc6-a2c0-4434-adfa-47f71ab01050 req-fe455130-9ecd-42c6-9b92-d9d1ac52ffd3 service nova] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:45:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:45:52 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Creating image(s)
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Ensure instance console log exists: /opt/stack/data/nova/instances/e8915914-b516-4422-8cb0-5ff9bc468f3a/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Start _get_guest_xml network_info=[{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'e8915914-b516-4422-8cb0-5ff9bc468f3a', 'attached_at': '', 'detached_at': '', 'volume_id': 'd1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'serial': 'd1d74925-6a9d-4e1b-b135-e0eb3318ace7'}, 'device_type': 'disk', 'attachment_id': '5bd9f489-b356-47b7-8a96-83f956db3051', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:45:52 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:45:52 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:45:52 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:45:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:45:52 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:45:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:45:52 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:45:53 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f9c2fc-0004-4e09-91ea-567fdec096c6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:45:53 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1df495-0ec1-4e68-8c80-56c322c6a374]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7] added
Nov 14 13:45:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce13719d-a4be-4d60-a953-4719bf30c5c1]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[58324ee3-f91d-46cd-acca-8a217ddf4372]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REMUuKnX {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v REMUuKnX" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ad8ed6-3cc3-4430-90d6-dbe7263c32d7]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'REMUuKnX'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbc4801b-c5cb-4bef-a24b-9dc0e6ec9cf9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[31f717c2-6b8a-4f1e-9883-31c4e80c9c37]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:45:53 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:45:53 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:45:53 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:45:53 user nova-compute[75258]: 
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5f0400-7be4-4dbe-abd3-168d8f420466]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]
Nov 14 13:45:53 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.
Nov 14 13:45:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[69d1a6b5-6557-41b0-983a-82cf1436ef4b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff3e6d00-c5f6-4106-b744-76381bfbac10]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:45:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:45:53 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.271s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] HCTL ('33', '-', '-', 0) found on session 62 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[34c8393f-f8bf-4caa-80af-200a3c2963c1]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:45:53 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 62 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.298s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== connect_volume: return (1299ms) {'type': 'block', 'scsi_wwn': '23365383862313136', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23365383862313136', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1485570533',display_name='tempest-TestVolumeBootPattern-server-1485570533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1485570533',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-9u0cegub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:45:48Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=e8915914-b516-4422-8cb0-5ff9bc468f3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2a:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a4588df-a898-4308-bafe-4414881c3e4c,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4588df-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.objects.instance [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'pci_devices' on Instance uuid e8915914-b516-4422-8cb0-5ff9bc468f3a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:45:54 user nova-compute[75258]:   <uuid>e8915914-b516-4422-8cb0-5ff9bc468f3a</uuid>
Nov 14 13:45:54 user nova-compute[75258]:   <name>instance-00000033</name>
Nov 14 13:45:54 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:45:54 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:45:54 user nova-compute[75258]:   <metadata>
Nov 14 13:45:54 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:45:54 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:45:54 user nova-compute[75258]:       <nova:name>tempest-TestVolumeBootPattern-server-1485570533</nova:name>
Nov 14 13:45:54 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:45:52</nova:creationTime>
Nov 14 13:45:54 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:45:54 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:45:54 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:45:54 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:45:54 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:45:54 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:45:54 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:45:54 user nova-compute[75258]:       <nova:owner>
Nov 14 13:45:54 user nova-compute[75258]:         <nova:user uuid="f07dfad770df4a19a3e3dcf2395627df">tempest-TestVolumeBootPattern-1658752255-project-member</nova:user>
Nov 14 13:45:54 user nova-compute[75258]:         <nova:project uuid="1155b95cdd314035aca38a33308cd9ff">tempest-TestVolumeBootPattern-1658752255</nova:project>
Nov 14 13:45:54 user nova-compute[75258]:       </nova:owner>
Nov 14 13:45:54 user nova-compute[75258]:       <nova:ports>
Nov 14 13:45:54 user nova-compute[75258]:         <nova:port uuid="2a4588df-a898-4308-bafe-4414881c3e4c">
Nov 14 13:45:54 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Nov 14 13:45:54 user nova-compute[75258]:         </nova:port>
Nov 14 13:45:54 user nova-compute[75258]:       </nova:ports>
Nov 14 13:45:54 user nova-compute[75258]:     </nova:instance>
Nov 14 13:45:54 user nova-compute[75258]:   </metadata>
Nov 14 13:45:54 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:45:54 user nova-compute[75258]:     <system>
Nov 14 13:45:54 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:45:54 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:45:54 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:45:54 user nova-compute[75258]:       <entry name="serial">e8915914-b516-4422-8cb0-5ff9bc468f3a</entry>
Nov 14 13:45:54 user nova-compute[75258]:       <entry name="uuid">e8915914-b516-4422-8cb0-5ff9bc468f3a</entry>
Nov 14 13:45:54 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:45:54 user nova-compute[75258]:     </system>
Nov 14 13:45:54 user nova-compute[75258]:   </sysinfo>
Nov 14 13:45:54 user nova-compute[75258]:   <os>
Nov 14 13:45:54 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:45:54 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:45:54 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:45:54 user nova-compute[75258]:   </os>
Nov 14 13:45:54 user nova-compute[75258]:   <features>
Nov 14 13:45:54 user nova-compute[75258]:     <acpi/>
Nov 14 13:45:54 user nova-compute[75258]:     <apic/>
Nov 14 13:45:54 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:45:54 user nova-compute[75258]:   </features>
Nov 14 13:45:54 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:45:54 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:45:54 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:45:54 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:45:54 user nova-compute[75258]:   </clock>
Nov 14 13:45:54 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:45:54 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:45:54 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:45:54 user nova-compute[75258]:   </cpu>
Nov 14 13:45:54 user nova-compute[75258]:   <devices>
Nov 14 13:45:54 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:45:54 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:45:54 user nova-compute[75258]:       <source dev="/dev/sdb"/>
Nov 14 13:45:54 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:45:54 user nova-compute[75258]:       <serial>d1d74925-6a9d-4e1b-b135-e0eb3318ace7</serial>
Nov 14 13:45:54 user nova-compute[75258]:     </disk>
Nov 14 13:45:54 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:45:54 user nova-compute[75258]:       <mac address="fa:16:3e:d2:2a:d1"/>
Nov 14 13:45:54 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:45:54 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:45:54 user nova-compute[75258]:       <target dev="tap2a4588df-a8"/>
Nov 14 13:45:54 user nova-compute[75258]:     </interface>
Nov 14 13:45:54 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:45:54 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/e8915914-b516-4422-8cb0-5ff9bc468f3a/console.log" append="off"/>
Nov 14 13:45:54 user nova-compute[75258]:     </serial>
Nov 14 13:45:54 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:45:54 user nova-compute[75258]:     <video>
Nov 14 13:45:54 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:45:54 user nova-compute[75258]:     </video>
Nov 14 13:45:54 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:45:54 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:45:54 user nova-compute[75258]:     </rng>
Nov 14 13:45:54 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:45:54 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:45:54 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:45:54 user nova-compute[75258]:     </memballoon>
Nov 14 13:45:54 user nova-compute[75258]:   </devices>
Nov 14 13:45:54 user nova-compute[75258]: </domain>
Nov 14 13:45:54 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1485570533',display_name='tempest-TestVolumeBootPattern-server-1485570533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1485570533',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-9u0cegub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:45:48Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=e8915914-b516-4422-8cb0-5ff9bc468f3a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2a:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a4588df-a898-4308-bafe-4414881c3e4c,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4588df-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG os_vif [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2a:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a4588df-a898-4308-bafe-4414881c3e4c,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4588df-a8') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3c4fbde8-baa6-5d79-ad6f-16ab00c7ea89', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a4588df-a8, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2a4588df-a8, col_values=(('qos', UUID('cac96538-eb46-4060-8fd8-6ce5513136d7')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2a4588df-a8, col_values=(('external_ids', {'iface-id': '2a4588df-a898-4308-bafe-4414881c3e4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d2:2a:d1', 'vm-uuid': 'e8915914-b516-4422-8cb0-5ff9bc468f3a'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:54 user nova-compute[75258]: INFO os_vif [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d2:2a:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a4588df-a898-4308-bafe-4414881c3e4c,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4588df-a8')
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:45:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No VIF found with MAC fa:16:3e:d2:2a:d1, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-bb0255bf-f3cc-4f80-99e4-288974f6346b req-766a9f80-42bf-4dc8-8864-2db4ad3c508f service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bb0255bf-f3cc-4f80-99e4-288974f6346b req-766a9f80-42bf-4dc8-8864-2db4ad3c508f service nova] Acquiring lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bb0255bf-f3cc-4f80-99e4-288974f6346b req-766a9f80-42bf-4dc8-8864-2db4ad3c508f service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bb0255bf-f3cc-4f80-99e4-288974f6346b req-766a9f80-42bf-4dc8-8864-2db4ad3c508f service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:55 user nova-compute[75258]: DEBUG nova.compute.manager [req-bb0255bf-f3cc-4f80-99e4-288974f6346b req-766a9f80-42bf-4dc8-8864-2db4ad3c508f service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] No waiting events found dispatching network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:45:55 user nova-compute[75258]: WARNING nova.compute.manager [req-bb0255bf-f3cc-4f80-99e4-288974f6346b req-766a9f80-42bf-4dc8-8864-2db4ad3c508f service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received unexpected event network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c for instance with vm_state building and task_state spawning.
Nov 14 13:45:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:45:57 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Instance spawned successfully.
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:45:57 user nova-compute[75258]: INFO nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Took 4.87 seconds to spawn the instance on the hypervisor.
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-6f0e94f2-30a1-4f09-8f4d-673187b8ea09 req-765c4eb4-cdb8-484e-ab1e-a969886496ed service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f0e94f2-30a1-4f09-8f4d-673187b8ea09 req-765c4eb4-cdb8-484e-ab1e-a969886496ed service nova] Acquiring lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f0e94f2-30a1-4f09-8f4d-673187b8ea09 req-765c4eb4-cdb8-484e-ab1e-a969886496ed service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-6f0e94f2-30a1-4f09-8f4d-673187b8ea09 req-765c4eb4-cdb8-484e-ab1e-a969886496ed service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:57 user nova-compute[75258]: DEBUG nova.compute.manager [req-6f0e94f2-30a1-4f09-8f4d-673187b8ea09 req-765c4eb4-cdb8-484e-ab1e-a969886496ed service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] No waiting events found dispatching network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:45:57 user nova-compute[75258]: WARNING nova.compute.manager [req-6f0e94f2-30a1-4f09-8f4d-673187b8ea09 req-765c4eb4-cdb8-484e-ab1e-a969886496ed service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received unexpected event network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c for instance with vm_state building and task_state spawning.
Nov 14 13:45:57 user nova-compute[75258]: INFO nova.compute.manager [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Took 9.83 seconds to build instance.
Nov 14 13:45:57 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-08b13356-3e51-492a-a22d-54d80a79d6bb tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.923s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:45:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid e8915914-b516-4422-8cb0-5ff9bc468f3a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:46:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:46:15 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:46:15 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:46:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8974MB free_disk=24.990814208984375GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance e8915914-b516-4422-8cb0-5ff9bc468f3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.247s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:46:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:46:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:46:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:46:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:46:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:46:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:46:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:46:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:47:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:47:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid e8915914-b516-4422-8cb0-5ff9bc468f3a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:47:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:47:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:47:17 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:47:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9041MB free_disk=24.990203857421875GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance e8915914-b516-4422-8cb0-5ff9bc468f3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:47:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.168s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:47:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:47:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:38 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-changed-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:47:39 user nova-compute[75258]: DEBUG nova.compute.manager [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Refreshing instance network info cache due to event network-changed-2a4588df-a898-4308-bafe-4414881c3e4c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:47:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:47:39 user nova-compute[75258]: DEBUG nova.network.neutron [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Refreshing network info cache for port 2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:47:40 user nova-compute[75258]: DEBUG nova.network.neutron [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updated VIF entry in instance network info cache for port 2a4588df-a898-4308-bafe-4414881c3e4c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:47:40 user nova-compute[75258]: DEBUG nova.network.neutron [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:47:40 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-9e5671df-df4f-4e34-8d31-20e2cf642245 req-d1a2cd2f-885d-4395-810b-dc7f09aac9ab service nova] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:47:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:47:44 user nova-compute[75258]: INFO nova.compute.claims [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Claim successful on node user
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.214s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:47:44 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.policy [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'f07dfad770df4a19a3e3dcf2395627df', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1155b95cdd314035aca38a33308cd9ff', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:47:44 user nova-compute[75258]: INFO nova.virt.block_device [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Booting with volume 7927d16b-5574-4701-b7b2-62234b7dc95c at /dev/vda
Nov 14 13:47:44 user nova-compute[75258]: DEBUG os_brick.utils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1cd3a99-b270-4a25-b575-4ad6edad2e94]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8998a10d-a2f5-4cdd-b2b3-ce060469ea6f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d1f295c-73d2-428c-ac66-7cba49ef281b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[84aef92c-f761-42c9-b5c4-8d049f0cb560]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:47:44 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:47:44 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fe0479-d390-4569-a3f6-24d2c6c9c9e5]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG os_brick.utils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:47:44 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating existing volume attachment record: 6447b6e8-9c39-49f2-aa0d-5b1196c56310 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Successfully created port: db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Successfully updated port: db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquired lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG nova.compute.manager [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-changed-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG nova.compute.manager [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Refreshing instance network info cache due to event network-changed-db59c5de-b39a-488e-9f97-90b009761f79. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:47:45 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] Acquiring lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG nova.network.neutron [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating instance_info_cache with network_info: [{"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Releasing lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Instance network_info: |[{"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] Acquired lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Refreshing network info cache for port db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updated VIF entry in instance network info cache for port db59c5de-b39a-488e-9f97-90b009761f79. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG nova.network.neutron [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating instance_info_cache with network_info: [{"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:47:46 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-1cdd745b-3fa9-4a2b-a1b4-258cb6da5b5e req-55fbb8f5-5a78-420c-9e64-e70b48bc962b service nova] Releasing lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:47:49 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Creating image(s)
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Did not create local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4863}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Ensure instance console log exists: /opt/stack/data/nova/instances/cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Start _get_guest_xml network_info=[{"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pybwchUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4', 'attached_at': '', 'detached_at': '', 'volume_id': '7927d16b-5574-4701-b7b2-62234b7dc95c', 'serial': '7927d16b-5574-4701-b7b2-62234b7dc95c'}, 'device_type': 'disk', 'attachment_id': '6447b6e8-9c39-49f2-aa0d-5b1196c56310', 'boot_index': 0, 'delete_on_termination': False, 'mount_device': '/dev/vda', 'guest_format': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:47:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:47:49 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pybwchUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:47:49 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:47:49 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:47:49 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5fbea0-5d35-44ef-887c-3410da4e2b07]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:47:49 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[861d6fe4-5b41-4d8b-860c-395c8fd9954c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c] added
Nov 14 13:47:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f115d249-0f44-476d-8334-680391571af3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e2c099-00cb-4bf2-8a21-0541ee6a380c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pybwchUq {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pybwchUq" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bc2e71-32aa-4e18-a254-331701399ea8]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pybwchUq'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f40e349b-a61d-4880-bcaa-3cd23f891228]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bb09fc4-3f81-4c9d-8c98-8dcd87f17f31]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:47:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:47:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4961ac-a2d0-447c-a317-79d0f26a49ff]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260]
Nov 14 13:47:49 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260] successful.
Nov 14 13:47:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[884fba40-846d-48e0-a450-bb4115d20821]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f46e416-09ad-4409-8298-94754997cb21]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:47:49 user nova-compute[75258]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c (non-flash)
Nov 14 13:47:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:47:49 user nova-compute[75258]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c (non-flash)
Nov 14 13:47:49 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.260s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] HCTL ('34', '-', '-', 0) found on session 63 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[76a92af7-57d6-47ad-ac61-ef06e4eb89ba]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Searching for a device in session 63 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:47:49 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pybwchUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.289s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== connect_volume: return (1290ms) {'type': 'block', 'scsi_wwn': '23234626564373630', 'path': '/dev/sdc'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23234626564373630', 'path': '/dev/sdc'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-991154620',display_name='tempest-TestVolumeBootPattern-server-991154620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-991154620',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-9306y0b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:47:45Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=db59c5de-b39a-488e-9f97-90b009761f79,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb59c5de-b3') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.objects.instance [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'pci_devices' on Instance uuid cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:47:50 user nova-compute[75258]:   <uuid>cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4</uuid>
Nov 14 13:47:50 user nova-compute[75258]:   <name>instance-00000034</name>
Nov 14 13:47:50 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:47:50 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:47:50 user nova-compute[75258]:   <metadata>
Nov 14 13:47:50 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:47:50 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:47:50 user nova-compute[75258]:       <nova:name>tempest-TestVolumeBootPattern-server-991154620</nova:name>
Nov 14 13:47:50 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:47:49</nova:creationTime>
Nov 14 13:47:50 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:47:50 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:47:50 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:47:50 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:47:50 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:47:50 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:47:50 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:47:50 user nova-compute[75258]:       <nova:owner>
Nov 14 13:47:50 user nova-compute[75258]:         <nova:user uuid="f07dfad770df4a19a3e3dcf2395627df">tempest-TestVolumeBootPattern-1658752255-project-member</nova:user>
Nov 14 13:47:50 user nova-compute[75258]:         <nova:project uuid="1155b95cdd314035aca38a33308cd9ff">tempest-TestVolumeBootPattern-1658752255</nova:project>
Nov 14 13:47:50 user nova-compute[75258]:       </nova:owner>
Nov 14 13:47:50 user nova-compute[75258]:       <nova:ports>
Nov 14 13:47:50 user nova-compute[75258]:         <nova:port uuid="db59c5de-b39a-488e-9f97-90b009761f79">
Nov 14 13:47:50 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Nov 14 13:47:50 user nova-compute[75258]:         </nova:port>
Nov 14 13:47:50 user nova-compute[75258]:       </nova:ports>
Nov 14 13:47:50 user nova-compute[75258]:     </nova:instance>
Nov 14 13:47:50 user nova-compute[75258]:   </metadata>
Nov 14 13:47:50 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:47:50 user nova-compute[75258]:     <system>
Nov 14 13:47:50 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:47:50 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:47:50 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:47:50 user nova-compute[75258]:       <entry name="serial">cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4</entry>
Nov 14 13:47:50 user nova-compute[75258]:       <entry name="uuid">cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4</entry>
Nov 14 13:47:50 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:47:50 user nova-compute[75258]:     </system>
Nov 14 13:47:50 user nova-compute[75258]:   </sysinfo>
Nov 14 13:47:50 user nova-compute[75258]:   <os>
Nov 14 13:47:50 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:47:50 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:47:50 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:47:50 user nova-compute[75258]:   </os>
Nov 14 13:47:50 user nova-compute[75258]:   <features>
Nov 14 13:47:50 user nova-compute[75258]:     <acpi/>
Nov 14 13:47:50 user nova-compute[75258]:     <apic/>
Nov 14 13:47:50 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:47:50 user nova-compute[75258]:   </features>
Nov 14 13:47:50 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:47:50 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:47:50 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:47:50 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:47:50 user nova-compute[75258]:   </clock>
Nov 14 13:47:50 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:47:50 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:47:50 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:47:50 user nova-compute[75258]:   </cpu>
Nov 14 13:47:50 user nova-compute[75258]:   <devices>
Nov 14 13:47:50 user nova-compute[75258]:     <disk type="block" device="disk">
Nov 14 13:47:50 user nova-compute[75258]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:47:50 user nova-compute[75258]:       <source dev="/dev/sdc"/>
Nov 14 13:47:50 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:47:50 user nova-compute[75258]:       <serial>7927d16b-5574-4701-b7b2-62234b7dc95c</serial>
Nov 14 13:47:50 user nova-compute[75258]:     </disk>
Nov 14 13:47:50 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:47:50 user nova-compute[75258]:       <mac address="fa:16:3e:3c:28:ea"/>
Nov 14 13:47:50 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:47:50 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:47:50 user nova-compute[75258]:       <target dev="tapdb59c5de-b3"/>
Nov 14 13:47:50 user nova-compute[75258]:     </interface>
Nov 14 13:47:50 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:47:50 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4/console.log" append="off"/>
Nov 14 13:47:50 user nova-compute[75258]:     </serial>
Nov 14 13:47:50 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:47:50 user nova-compute[75258]:     <video>
Nov 14 13:47:50 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:47:50 user nova-compute[75258]:     </video>
Nov 14 13:47:50 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:47:50 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:47:50 user nova-compute[75258]:     </rng>
Nov 14 13:47:50 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:47:50 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:47:50 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:47:50 user nova-compute[75258]:     </memballoon>
Nov 14 13:47:50 user nova-compute[75258]:   </devices>
Nov 14 13:47:50 user nova-compute[75258]: </domain>
Nov 14 13:47:50 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-991154620',display_name='tempest-TestVolumeBootPattern-server-991154620',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-991154620',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-9306y0b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:47:45Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=db59c5de-b39a-488e-9f97-90b009761f79,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb59c5de-b3') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG os_vif [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=db59c5de-b39a-488e-9f97-90b009761f79,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb59c5de-b3') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a2b1cbe6-a690-528f-9c46-886016040457', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdb59c5de-b3, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdb59c5de-b3, col_values=(('qos', UUID('244d107f-a9be-48e1-9469-5a1aa6e8d86b')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdb59c5de-b3, col_values=(('external_ids', {'iface-id': 'db59c5de-b39a-488e-9f97-90b009761f79', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3c:28:ea', 'vm-uuid': 'cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:50 user nova-compute[75258]: INFO os_vif [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3c:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=db59c5de-b39a-488e-9f97-90b009761f79,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb59c5de-b3')
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:47:50 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] No VIF found with MAC fa:16:3e:3c:28:ea, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:47:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-d589c892-b778-4cd3-a6e4-ca619d272d1d req-cb8b47ce-3baf-4ad1-9161-0ab174853516 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:47:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d589c892-b778-4cd3-a6e4-ca619d272d1d req-cb8b47ce-3baf-4ad1-9161-0ab174853516 service nova] Acquiring lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:47:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d589c892-b778-4cd3-a6e4-ca619d272d1d req-cb8b47ce-3baf-4ad1-9161-0ab174853516 service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:47:52 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d589c892-b778-4cd3-a6e4-ca619d272d1d req-cb8b47ce-3baf-4ad1-9161-0ab174853516 service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:47:52 user nova-compute[75258]: DEBUG nova.compute.manager [req-d589c892-b778-4cd3-a6e4-ca619d272d1d req-cb8b47ce-3baf-4ad1-9161-0ab174853516 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] No waiting events found dispatching network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:47:52 user nova-compute[75258]: WARNING nova.compute.manager [req-d589c892-b778-4cd3-a6e4-ca619d272d1d req-cb8b47ce-3baf-4ad1-9161-0ab174853516 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received unexpected event network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 for instance with vm_state building and task_state spawning.
Nov 14 13:47:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:47:54 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Instance spawned successfully.
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-b352c202-cd61-4e61-b92a-e2c8321aee5b req-3a7d4cf6-2ed8-46d5-b209-fba800ab68d8 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b352c202-cd61-4e61-b92a-e2c8321aee5b req-3a7d4cf6-2ed8-46d5-b209-fba800ab68d8 service nova] Acquiring lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b352c202-cd61-4e61-b92a-e2c8321aee5b req-3a7d4cf6-2ed8-46d5-b209-fba800ab68d8 service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b352c202-cd61-4e61-b92a-e2c8321aee5b req-3a7d4cf6-2ed8-46d5-b209-fba800ab68d8 service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.compute.manager [req-b352c202-cd61-4e61-b92a-e2c8321aee5b req-3a7d4cf6-2ed8-46d5-b209-fba800ab68d8 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] No waiting events found dispatching network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:47:54 user nova-compute[75258]: WARNING nova.compute.manager [req-b352c202-cd61-4e61-b92a-e2c8321aee5b req-3a7d4cf6-2ed8-46d5-b209-fba800ab68d8 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received unexpected event network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 for instance with vm_state building and task_state spawning.
Nov 14 13:47:54 user nova-compute[75258]: INFO nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Took 4.98 seconds to spawn the instance on the hypervisor.
Nov 14 13:47:54 user nova-compute[75258]: DEBUG nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:47:54 user nova-compute[75258]: INFO nova.compute.manager [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Took 10.14 seconds to build instance.
Nov 14 13:47:54 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-0dbf89f5-aedd-4534-a12b-ed36a01e4504 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.240s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:47:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:47:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:48:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:48:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:48:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:16 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid e8915914-b516-4422-8cb0-5ff9bc468f3a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:48:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:48:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:48:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8951MB free_disk=24.988433837890625GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance e8915914-b516-4422-8cb0-5ff9bc468f3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:48:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.201s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:34 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:48:34 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:48:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:48:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:48:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:48:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:48:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:48:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:48:55 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:49:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:49:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:49:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:49:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:09 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:11 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:49:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:49:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating instance_info_cache with network_info: [{"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:49:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:49:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:49:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8981MB free_disk=24.98781967163086GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance e8915914-b516-4422-8cb0-5ff9bc468f3a actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:49:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.306s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:49:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-changed-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:49:35 user nova-compute[75258]: DEBUG nova.compute.manager [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Refreshing instance network info cache due to event network-changed-db59c5de-b39a-488e-9f97-90b009761f79. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] Acquiring lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:49:35 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] Acquired lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:49:35 user nova-compute[75258]: DEBUG nova.network.neutron [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Refreshing network info cache for port db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:49:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updated VIF entry in instance network info cache for port db59c5de-b39a-488e-9f97-90b009761f79. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG nova.network.neutron [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating instance_info_cache with network_info: [{"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.200", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-bf018c18-767a-49f7-8991-810479dd2332 req-f22ff4dd-c4ef-47e0-9d31-0628e53c442a service nova] Releasing lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:49:36 user nova-compute[75258]: INFO nova.compute.manager [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Terminating instance
Nov 14 13:49:36 user nova-compute[75258]: DEBUG nova.compute.manager [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-4dfc88a1-e81c-4e97-a30f-0c3f4d97bb96 req-299b6cc6-ad6a-4174-bb40-49ac33e52463 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-vif-unplugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4dfc88a1-e81c-4e97-a30f-0c3f4d97bb96 req-299b6cc6-ad6a-4174-bb40-49ac33e52463 service nova] Acquiring lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4dfc88a1-e81c-4e97-a30f-0c3f4d97bb96 req-299b6cc6-ad6a-4174-bb40-49ac33e52463 service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4dfc88a1-e81c-4e97-a30f-0c3f4d97bb96 req-299b6cc6-ad6a-4174-bb40-49ac33e52463 service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-4dfc88a1-e81c-4e97-a30f-0c3f4d97bb96 req-299b6cc6-ad6a-4174-bb40-49ac33e52463 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] No waiting events found dispatching network-vif-unplugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG nova.compute.manager [req-4dfc88a1-e81c-4e97-a30f-0c3f4d97bb96 req-299b6cc6-ad6a-4174-bb40-49ac33e52463 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-vif-unplugged-db59c5de-b39a-488e-9f97-90b009761f79 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Instance destroyed successfully.
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'resources' on Instance uuid cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:47:43Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-991154620',display_name='tempest-TestVolumeBootPattern-server-991154620',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-991154620',id=52,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:47:54Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-9306y0b1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:47:54Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3c:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=db59c5de-b39a-488e-9f97-90b009761f79,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb59c5de-b3') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_vif [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=db59c5de-b39a-488e-9f97-90b009761f79,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb59c5de-b3') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdb59c5de-b3, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=244d107f-a9be-48e1-9469-5a1aa6e8d86b) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:37 user nova-compute[75258]: INFO os_vif [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3c:28:ea,bridge_name='br-int',has_traffic_filtering=True,id=db59c5de-b39a-488e-9f97-90b009761f79,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdb59c5de-b3')
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pybwchUq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:49:37 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c03659ce-b80a-44f6-9bab-784b3432b903]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:49:37 user nova-compute[75258]: No targets found.
Nov 14 13:49:37 user nova-compute[75258]: iSNS:
Nov 14 13:49:37 user nova-compute[75258]: No targets found.
Nov 14 13:49:37 user nova-compute[75258]: STATIC:
Nov 14 13:49:37 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7
Nov 14 13:49:37 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:49:37 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:49:37 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c
Nov 14 13:49:37 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:49:37 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:49:37 user nova-compute[75258]: FIRMWARE:
Nov 14 13:49:37 user nova-compute[75258]: No targets found.
Nov 14 13:49:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:49:37 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:49:37 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0cf40-2ccd-4da7-afb3-eee97c0ce22c]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[874d11cc-8c04-4e72-bfc1-7ee290ed8920]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)\ntcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:49:37 user nova-compute[75258]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c (non-flash)
Nov 14 13:49:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:49:37 user nova-compute[75258]: tcp: [63] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c (non-flash)
Nov 14 13:49:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd4b464ecb0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c'): ({'sdc'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Removing single pathed devices sdc {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb4beea-7a20-4792-aa15-f6fac6d1edf8]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb3c852-30c9-4a50-b3db-6fd8be777d25]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flushing IO for device /dev/sdc {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0def1ebd-fe30-4c14-955b-1d7f97604472]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.053s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e23d55cf-4e4c-4d6e-b520-cd12cd69cb93]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] SCSI volumes sdc have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ad5a3e2-b6fb-4a93-9d08-e66248e1e4f3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa93c612-b5a9-477b-84e6-33f4cfb5a6b5]: (4, ('Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260]\nLogout of [sid: 63, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 63, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260]
Nov 14 13:49:37 user nova-compute[75258]: Logout of [sid: 63, target: iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c, portal: 172.16.0.220,3260] successful.
Nov 14 13:49:37 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7927d16b-5574-4701-b7b2-62234b7dc95c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2785473-6f1d-4579-82cf-3cbffa199aef]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== disconnect_volume: return (291ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:49:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Deleting instance files /opt/stack/data/nova/instances/cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4_del
Nov 14 13:49:37 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Deletion of /opt/stack/data/nova/instances/cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4_del complete
Nov 14 13:49:37 user nova-compute[75258]: INFO nova.compute.manager [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Took 1.14 seconds to destroy the instance on the hypervisor.
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-changed-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.compute.manager [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Refreshing instance network info cache due to event network-changed-db59c5de-b39a-488e-9f97-90b009761f79. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] Acquiring lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] Acquired lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.network.neutron [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Refreshing network info cache for port db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:49:37 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:49:38 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Took 0.42 seconds to deallocate network for instance.
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-229aeef8-b994-46af-acb8-39cb32f90bdf req-0db5ae8d-08e1-4b85-837e-ad7e682f8166 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-vif-deleted-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:49:38 user nova-compute[75258]: INFO nova.compute.manager [req-229aeef8-b994-46af-acb8-39cb32f90bdf req-0db5ae8d-08e1-4b85-837e-ad7e682f8166 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Neutron deleted interface db59c5de-b39a-488e-9f97-90b009761f79; detaching it from the instance and deleting it from the info cache
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-229aeef8-b994-46af-acb8-39cb32f90bdf req-0db5ae8d-08e1-4b85-837e-ad7e682f8166 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-229aeef8-b994-46af-acb8-39cb32f90bdf req-0db5ae8d-08e1-4b85-837e-ad7e682f8166 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Detach interface failed, port_id=db59c5de-b39a-488e-9f97-90b009761f79, reason: Instance cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4 could not be found. {{(pid=75258) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10946}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updated VIF entry in instance network info cache for port db59c5de-b39a-488e-9f97-90b009761f79. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.network.neutron [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Updating instance_info_cache with network_info: [{"id": "db59c5de-b39a-488e-9f97-90b009761f79", "address": "fa:16:3e:3c:28:ea", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdb59c5de-b3", "ovs_interfaceid": "db59c5de-b39a-488e-9f97-90b009761f79", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-c9d58923-129a-441e-9619-270014dd493f req-269d7b87-83ae-4228-aa69-b208c49c48c5 service nova] Releasing lock "refresh_cache-cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:49:38 user nova-compute[75258]: INFO nova.compute.manager [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-8b77e0c2-4356-46c5-88ff-1d2778ec5b35 req-218098a1-5986-4b02-8f06-b3d90fe9928c service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received event network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8b77e0c2-4356-46c5-88ff-1d2778ec5b35 req-218098a1-5986-4b02-8f06-b3d90fe9928c service nova] Acquiring lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8b77e0c2-4356-46c5-88ff-1d2778ec5b35 req-218098a1-5986-4b02-8f06-b3d90fe9928c service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-8b77e0c2-4356-46c5-88ff-1d2778ec5b35 req-218098a1-5986-4b02-8f06-b3d90fe9928c service nova] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.compute.manager [req-8b77e0c2-4356-46c5-88ff-1d2778ec5b35 req-218098a1-5986-4b02-8f06-b3d90fe9928c service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] No waiting events found dispatching network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:49:38 user nova-compute[75258]: WARNING nova.compute.manager [req-8b77e0c2-4356-46c5-88ff-1d2778ec5b35 req-218098a1-5986-4b02-8f06-b3d90fe9928c service nova] [instance: cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4] Received unexpected event network-vif-plugged-db59c5de-b39a-488e-9f97-90b009761f79 for instance with vm_state active and task_state deleting.
Nov 14 13:49:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:49:38 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.127s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:49:38 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Deleted allocations for instance cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4
Nov 14 13:49:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f27374da-9c3e-4815-9854-885cb59985f6 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "cdd68fdf-eecb-4652-bd34-e4a4b46ab5e4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.563s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:49:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:42 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:49:47 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:47 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:49:52 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:49:57 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:01 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:02 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:07 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:10 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:12 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:50:17 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:50:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:50:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:50:19 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:50:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=75258) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Nov 14 13:50:19 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:50:20 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:50:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9060MB free_disk=24.9869384765625GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance e8915914-b516-4422-8cb0-5ff9bc468f3a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:50:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid e8915914-b516-4422-8cb0-5ff9bc468f3a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:50:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:50:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:28 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-changed-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG nova.compute.manager [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Refreshing instance network info cache due to event network-changed-2a4588df-a898-4308-bafe-4414881c3e4c. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] Acquiring lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] Acquired lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG nova.network.neutron [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Refreshing network info cache for port 2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "e8915914-b516-4422-8cb0-5ff9bc468f3a" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:50:30 user nova-compute[75258]: INFO nova.compute.manager [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Terminating instance
Nov 14 13:50:30 user nova-compute[75258]: DEBUG nova.compute.manager [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.network.neutron [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updated VIF entry in instance network info cache for port 2a4588df-a898-4308-bafe-4414881c3e4c. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.network.neutron [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [{"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-a3d084b8-5ccc-492b-a5db-4fa5cb115ad7 req-75ef4e2f-d837-4642-8de7-a2c248c6017d service nova] Releasing lock "refresh_cache-e8915914-b516-4422-8cb0-5ff9bc468f3a" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:50:31 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Instance destroyed successfully.
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.objects.instance [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lazy-loading 'resources' on Instance uuid e8915914-b516-4422-8cb0-5ff9bc468f3a {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:45:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1485570533',display_name='tempest-TestVolumeBootPattern-server-1485570533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1485570533',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDhPDYgQwwVb5ZsNZ6XjV0zsBkEsJpbitqHNThnnj/aYmTPWsDfJx+6BapoTb9RGDu/QdbTVwDRjmxh/2tyDppqCqi0LXtftYbWEf/2LeULEnMrNXU9bZyq20ra50G9w7A==',key_name='tempest-TestVolumeBootPattern-1952760684',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:45:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='1155b95cdd314035aca38a33308cd9ff',ramdisk_id='',reservation_id='r-9u0cegub',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-1658752255',owner_user_name='tempest-TestVolumeBootPattern-1658752255-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:45:58Z,user_data=None,user_id='f07dfad770df4a19a3e3dcf2395627df',uuid=e8915914-b516-4422-8cb0-5ff9bc468f3a,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converting VIF {"id": "2a4588df-a898-4308-bafe-4414881c3e4c", "address": "fa:16:3e:d2:2a:d1", "network": {"id": "f3d812f9-410e-423d-9bdc-3ae5862d73a0", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1131219376-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.67", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "1155b95cdd314035aca38a33308cd9ff", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a4588df-a8", "ovs_interfaceid": "2a4588df-a898-4308-bafe-4414881c3e4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2a:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a4588df-a898-4308-bafe-4414881c3e4c,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4588df-a8') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_vif [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2a:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a4588df-a898-4308-bafe-4414881c3e4c,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4588df-a8') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a4588df-a8, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cac96538-eb46-4060-8fd8-6ce5513136d7) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:31 user nova-compute[75258]: INFO os_vif [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:d2:2a:d1,bridge_name='br-int',has_traffic_filtering=True,id=2a4588df-a898-4308-bafe-4414881c3e4c,network=Network(f3d812f9-410e-423d-9bdc-3ae5862d73a0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a4588df-a8')
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'REMUuKnX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:50:31 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db8dabf-5366-4ee9-a31e-9f1bb2dd1795]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:50:31 user nova-compute[75258]: No targets found.
Nov 14 13:50:31 user nova-compute[75258]: iSNS:
Nov 14 13:50:31 user nova-compute[75258]: No targets found.
Nov 14 13:50:31 user nova-compute[75258]: STATIC:
Nov 14 13:50:31 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7
Nov 14 13:50:31 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:50:31 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:50:31 user nova-compute[75258]: FIRMWARE:
Nov 14 13:50:31 user nova-compute[75258]: No targets found.
Nov 14 13:50:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:50:31 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:50:31 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4af2a1b1-ecc9-4533-ab3f-642adbf00c56]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd07014c-0482-476f-ab42-ecb81044f397]: (4, ('tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:50:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsi session list stdout=tcp: [62] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 (non-flash)
Nov 14 13:50:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c439870>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bd93f70-61c8-48d4-930c-be4d5dffe384]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55e4823-842d-4c58-b32a-b74181d943e3]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4124851c-f529-4321-9765-33eb2c5b00ac]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c9d5de-6da7-4f1f-a75e-0b9183f077a2]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-23365383862313136', '/dev/disk/by-id/scsi-1SCST_BIO68fccba6-3e88b1167cf739be', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_68fccba6') {{(pid=86014) unlink_root /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/privileged/rootwrap.py:219}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d91bd3-379e-4dc3-8d16-d941ff64308e]: (4, None) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[896704c4-3bf0-44a6-a82d-af8e978f9aba]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe398ee-c678-433b-818f-e561f5f9c479]: (4, ('Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]\nLogout of [sid: 62, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 62, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260]
Nov 14 13:50:31 user nova-compute[75258]: Logout of [sid: 62, target: iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7, portal: 172.16.0.220,3260] successful.
Nov 14 13:50:31 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d1d74925-6a9d-4e1b-b135-e0eb3318ace7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[493ad97d-ab5d-4a50-b6b2-1306e825c0ee]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] <== disconnect_volume: return (283ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:50:31 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Deleting instance files /opt/stack/data/nova/instances/e8915914-b516-4422-8cb0-5ff9bc468f3a_del
Nov 14 13:50:31 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Deletion of /opt/stack/data/nova/instances/e8915914-b516-4422-8cb0-5ff9bc468f3a_del complete
Nov 14 13:50:31 user nova-compute[75258]: INFO nova.compute.manager [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Took 1.12 seconds to destroy the instance on the hypervisor.
Nov 14 13:50:31 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:50:31 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:50:32 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Took 0.50 seconds to deallocate network for instance.
Nov 14 13:50:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-bc3ff79c-5ede-4b0f-8d30-4dd9e6edb617 req-ac831576-2606-4c9d-9917-8c3d40d5a677 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-vif-deleted-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-vif-unplugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] Acquiring lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] No waiting events found dispatching network-vif-unplugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-vif-unplugged-2a4588df-a898-4308-bafe-4414881c3e4c for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received event network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] Acquiring lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:50:32 user nova-compute[75258]: DEBUG nova.compute.manager [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] No waiting events found dispatching network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:50:32 user nova-compute[75258]: WARNING nova.compute.manager [req-e0f053a4-8f41-47d8-b1de-643e09e64976 req-9754fa60-9cfc-4eef-be6c-ace391604f35 service nova] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Received unexpected event network-vif-plugged-2a4588df-a898-4308-bafe-4414881c3e4c for instance with vm_state active and task_state deleting.
Nov 14 13:50:33 user nova-compute[75258]: INFO nova.compute.manager [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] [instance: e8915914-b516-4422-8cb0-5ff9bc468f3a] Took 0.70 seconds to detach 1 volumes for instance.
Nov 14 13:50:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:50:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:50:33 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:50:33 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:50:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:50:33 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Deleted allocations for instance e8915914-b516-4422-8cb0-5ff9bc468f3a
Nov 14 13:50:33 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-dbe57b9f-3f2e-426a-9173-894607655062 tempest-TestVolumeBootPattern-1658752255 tempest-TestVolumeBootPattern-1658752255-project-member] Lock "e8915914-b516-4422-8cb0-5ff9bc468f3a" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.727s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:50:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:50:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:50:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:51:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:51:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:51:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:51:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:13 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:51:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:51:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:51:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:51:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:51:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:51:21 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:51:21 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:51:21 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9190MB free_disk=24.978271484375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:51:21 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:51:22 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:22 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:51:22 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:51:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:51:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.249s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:51:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:27 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:31 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:36 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:41 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:51:46 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:48 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:51:51 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:56 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:51:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:00 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:01 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:03 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:06 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Starting instance... {{(pid=75258) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2422}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=75258) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2366}}
Nov 14 13:52:11 user nova-compute[75258]: INFO nova.compute.claims [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Claim successful on node user
Nov 14 13:52:11 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.226s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Start building networks asynchronously for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2819}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Allocating IP information in the background. {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1972}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] allocate_for_instance() {{(pid=75258) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Nov 14 13:52:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Start building block device mappings for instance. {{(pid=75258) _build_resources /opt/stack/nova/nova/compute/manager.py:2854}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Start spawning the instance on the hypervisor. {{(pid=75258) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2628}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Creating instance directory {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4727}}
Nov 14 13:52:11 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Creating image(s)
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "/opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "/opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "/opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG nova.policy [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8d0a9b3b072440c48b6be1ba64056b64', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4ec754f200c54f5db97d0706ca7d9c12', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=75258) authorize /opt/stack/nova/nova/policy.py:203}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.206s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "5953b672b09d92bbfe59816f074eff61dfd18dae" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk 1073741824 {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae,backing_fmt=raw /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk 1073741824" returned: 0 in 0.059s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "5953b672b09d92bbfe59816f074eff61dfd18dae" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.257s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae --force-share --output=json" returned: 0 in 0.191s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Checking if we can resize image /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk. size=1073741824 {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Successfully created port: ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG nova.virt.disk.api [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Cannot resize image /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk to a smaller size. {{(pid=75258) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Created local disks {{(pid=75258) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4861}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Ensure instance console log exists: /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/console.log {{(pid=75258) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4613}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Successfully updated port: ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Building network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2009}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-changed-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.compute.manager [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Refreshing instance network info cache due to event network-changed-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Instance cache missing network info. {{(pid=75258) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3322}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.network.neutron [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Instance network_info: |[{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=75258) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1987}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.network.neutron [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Refreshing network info cache for port ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Start _get_guest_xml network_info=[{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_name': '/dev/vda', 'encrypted': False, 'encryption_options': None, 'size': 0, 'device_type': 'disk', 'encryption_secret_uuid': None, 'boot_index': 0, 'guest_format': None, 'encryption_format': None, 'disk_bus': 'virtio', 'image_id': 'b293cbf1-70d3-49f7-8a42-771d90e2ec06'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7562}}
Nov 14 13:52:13 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:52:13 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CPU controller missing on host. {{(pid=75258) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.host [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CPU controller found on host. {{(pid=75258) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Nov 14 13:52:13 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=75258) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5400}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-11-14T12:32:18Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-11-14T12:32:30Z,direct_url=<?>,disk_format='qcow2',id=b293cbf1-70d3-49f7-8a42-771d90e2ec06,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='e9df3caeab9442b7b1d26e5e1a6df527',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-11-14T12:32:32Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:563}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Flavor limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:348}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Image limits 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:352}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Flavor pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:388}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Image pref 0:0:0 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:392}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=75258) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:430}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:569}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:471}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Got 1 possible topologies {{(pid=75258) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:501}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:575}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.hardware [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=75258) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:577}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-327591221',display_name='tempest-SnapshotDataIntegrityTests-server-327591221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-327591221',id=53,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVTFxLT7SWXbLAsEeNNALOAjjb2sMjm65tfZqUImxh9zeHYp4EaWbPXBXObykZSc3g/BSKcPjVvEegngCgPvxoLuuVYwh5CmSVp6esANdUlzlZLHsUAIDUCHa2pHZTydg==',key_name='tempest-keypair-1488094953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec754f200c54f5db97d0706ca7d9c12',ramdisk_id='',reservation_id='r-v3r0o9l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1169061154',owner_user_name='tempest-SnapshotDataIntegrityTests-1169061154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a9b3b072440c48b6be1ba64056b64',uuid=785be94c-fda0-47b6-a345-39f3ba6043e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=75258) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Converting VIF {"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=ec5f7cc6-4a67-45ee-8f8a-7637d6e74016,network=Network(575a863d-c2c1-48c4-a7eb-731e776c0881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5f7cc6-4a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.objects.instance [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'pci_devices' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] End _get_guest_xml xml=<domain type="kvm">
Nov 14 13:52:14 user nova-compute[75258]:   <uuid>785be94c-fda0-47b6-a345-39f3ba6043e2</uuid>
Nov 14 13:52:14 user nova-compute[75258]:   <name>instance-00000035</name>
Nov 14 13:52:14 user nova-compute[75258]:   <memory>524288</memory>
Nov 14 13:52:14 user nova-compute[75258]:   <vcpu>1</vcpu>
Nov 14 13:52:14 user nova-compute[75258]:   <metadata>
Nov 14 13:52:14 user nova-compute[75258]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Nov 14 13:52:14 user nova-compute[75258]:       <nova:package version="0.0.0"/>
Nov 14 13:52:14 user nova-compute[75258]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-327591221</nova:name>
Nov 14 13:52:14 user nova-compute[75258]:       <nova:creationTime>2023-11-14 13:52:13</nova:creationTime>
Nov 14 13:52:14 user nova-compute[75258]:       <nova:flavor name="m1.tiny">
Nov 14 13:52:14 user nova-compute[75258]:         <nova:memory>512</nova:memory>
Nov 14 13:52:14 user nova-compute[75258]:         <nova:disk>1</nova:disk>
Nov 14 13:52:14 user nova-compute[75258]:         <nova:swap>0</nova:swap>
Nov 14 13:52:14 user nova-compute[75258]:         <nova:ephemeral>0</nova:ephemeral>
Nov 14 13:52:14 user nova-compute[75258]:         <nova:vcpus>1</nova:vcpus>
Nov 14 13:52:14 user nova-compute[75258]:       </nova:flavor>
Nov 14 13:52:14 user nova-compute[75258]:       <nova:owner>
Nov 14 13:52:14 user nova-compute[75258]:         <nova:user uuid="8d0a9b3b072440c48b6be1ba64056b64">tempest-SnapshotDataIntegrityTests-1169061154-project-member</nova:user>
Nov 14 13:52:14 user nova-compute[75258]:         <nova:project uuid="4ec754f200c54f5db97d0706ca7d9c12">tempest-SnapshotDataIntegrityTests-1169061154</nova:project>
Nov 14 13:52:14 user nova-compute[75258]:       </nova:owner>
Nov 14 13:52:14 user nova-compute[75258]:       <nova:root type="image" uuid="b293cbf1-70d3-49f7-8a42-771d90e2ec06"/>
Nov 14 13:52:14 user nova-compute[75258]:       <nova:ports>
Nov 14 13:52:14 user nova-compute[75258]:         <nova:port uuid="ec5f7cc6-4a67-45ee-8f8a-7637d6e74016">
Nov 14 13:52:14 user nova-compute[75258]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Nov 14 13:52:14 user nova-compute[75258]:         </nova:port>
Nov 14 13:52:14 user nova-compute[75258]:       </nova:ports>
Nov 14 13:52:14 user nova-compute[75258]:     </nova:instance>
Nov 14 13:52:14 user nova-compute[75258]:   </metadata>
Nov 14 13:52:14 user nova-compute[75258]:   <sysinfo type="smbios">
Nov 14 13:52:14 user nova-compute[75258]:     <system>
Nov 14 13:52:14 user nova-compute[75258]:       <entry name="manufacturer">OpenStack Foundation</entry>
Nov 14 13:52:14 user nova-compute[75258]:       <entry name="product">OpenStack Nova</entry>
Nov 14 13:52:14 user nova-compute[75258]:       <entry name="version">0.0.0</entry>
Nov 14 13:52:14 user nova-compute[75258]:       <entry name="serial">785be94c-fda0-47b6-a345-39f3ba6043e2</entry>
Nov 14 13:52:14 user nova-compute[75258]:       <entry name="uuid">785be94c-fda0-47b6-a345-39f3ba6043e2</entry>
Nov 14 13:52:14 user nova-compute[75258]:       <entry name="family">Virtual Machine</entry>
Nov 14 13:52:14 user nova-compute[75258]:     </system>
Nov 14 13:52:14 user nova-compute[75258]:   </sysinfo>
Nov 14 13:52:14 user nova-compute[75258]:   <os>
Nov 14 13:52:14 user nova-compute[75258]:     <type arch="x86_64" machine="pc">hvm</type>
Nov 14 13:52:14 user nova-compute[75258]:     <boot dev="hd"/>
Nov 14 13:52:14 user nova-compute[75258]:     <smbios mode="sysinfo"/>
Nov 14 13:52:14 user nova-compute[75258]:   </os>
Nov 14 13:52:14 user nova-compute[75258]:   <features>
Nov 14 13:52:14 user nova-compute[75258]:     <acpi/>
Nov 14 13:52:14 user nova-compute[75258]:     <apic/>
Nov 14 13:52:14 user nova-compute[75258]:     <vmcoreinfo/>
Nov 14 13:52:14 user nova-compute[75258]:   </features>
Nov 14 13:52:14 user nova-compute[75258]:   <clock offset="utc">
Nov 14 13:52:14 user nova-compute[75258]:     <timer name="pit" tickpolicy="delay"/>
Nov 14 13:52:14 user nova-compute[75258]:     <timer name="rtc" tickpolicy="catchup"/>
Nov 14 13:52:14 user nova-compute[75258]:     <timer name="hpet" present="no"/>
Nov 14 13:52:14 user nova-compute[75258]:   </clock>
Nov 14 13:52:14 user nova-compute[75258]:   <cpu mode="custom" match="exact">
Nov 14 13:52:14 user nova-compute[75258]:     <model>Nehalem</model>
Nov 14 13:52:14 user nova-compute[75258]:     <topology sockets="1" cores="1" threads="1"/>
Nov 14 13:52:14 user nova-compute[75258]:   </cpu>
Nov 14 13:52:14 user nova-compute[75258]:   <devices>
Nov 14 13:52:14 user nova-compute[75258]:     <disk type="file" device="disk">
Nov 14 13:52:14 user nova-compute[75258]:       <driver name="qemu" type="qcow2" cache="none"/>
Nov 14 13:52:14 user nova-compute[75258]:       <source file="/opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk"/>
Nov 14 13:52:14 user nova-compute[75258]:       <target dev="vda" bus="virtio"/>
Nov 14 13:52:14 user nova-compute[75258]:     </disk>
Nov 14 13:52:14 user nova-compute[75258]:     <interface type="ethernet">
Nov 14 13:52:14 user nova-compute[75258]:       <mac address="fa:16:3e:9f:e2:11"/>
Nov 14 13:52:14 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:52:14 user nova-compute[75258]:       <mtu size="1442"/>
Nov 14 13:52:14 user nova-compute[75258]:       <target dev="tapec5f7cc6-4a"/>
Nov 14 13:52:14 user nova-compute[75258]:     </interface>
Nov 14 13:52:14 user nova-compute[75258]:     <serial type="pty">
Nov 14 13:52:14 user nova-compute[75258]:       <log file="/opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/console.log" append="off"/>
Nov 14 13:52:14 user nova-compute[75258]:     </serial>
Nov 14 13:52:14 user nova-compute[75258]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Nov 14 13:52:14 user nova-compute[75258]:     <video>
Nov 14 13:52:14 user nova-compute[75258]:       <model type="virtio"/>
Nov 14 13:52:14 user nova-compute[75258]:     </video>
Nov 14 13:52:14 user nova-compute[75258]:     <rng model="virtio">
Nov 14 13:52:14 user nova-compute[75258]:       <backend model="random">/dev/urandom</backend>
Nov 14 13:52:14 user nova-compute[75258]:     </rng>
Nov 14 13:52:14 user nova-compute[75258]:     <controller type="usb" index="0" model="none"/>
Nov 14 13:52:14 user nova-compute[75258]:     <memballoon model="virtio">
Nov 14 13:52:14 user nova-compute[75258]:       <stats period="10"/>
Nov 14 13:52:14 user nova-compute[75258]:     </memballoon>
Nov 14 13:52:14 user nova-compute[75258]:   </devices>
Nov 14 13:52:14 user nova-compute[75258]: </domain>
Nov 14 13:52:14 user nova-compute[75258]:  {{(pid=75258) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7568}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-327591221',display_name='tempest-SnapshotDataIntegrityTests-server-327591221',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-327591221',id=53,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVTFxLT7SWXbLAsEeNNALOAjjb2sMjm65tfZqUImxh9zeHYp4EaWbPXBXObykZSc3g/BSKcPjVvEegngCgPvxoLuuVYwh5CmSVp6esANdUlzlZLHsUAIDUCHa2pHZTydg==',key_name='tempest-keypair-1488094953',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4ec754f200c54f5db97d0706ca7d9c12',ramdisk_id='',reservation_id='r-v3r0o9l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-1169061154',owner_user_name='tempest-SnapshotDataIntegrityTests-1169061154-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-11-14T13:52:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a9b3b072440c48b6be1ba64056b64',uuid=785be94c-fda0-47b6-a345-39f3ba6043e2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Converting VIF {"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=ec5f7cc6-4a67-45ee-8f8a-7637d6e74016,network=Network(575a863d-c2c1-48c4-a7eb-731e776c0881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5f7cc6-4a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG os_vif [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=ec5f7cc6-4a67-45ee-8f8a-7637d6e74016,network=Network(575a863d-c2c1-48c4-a7eb-731e776c0881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5f7cc6-4a') {{(pid=75258) plug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:76}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '03c01558-af75-5c25-bfe0-687c9c140a6d', '_type': 'linux-noop'}}, row=False) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapec5f7cc6-4a, may_exist=True, interface_attrs={}) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapec5f7cc6-4a, col_values=(('qos', UUID('95a54cb8-e855-4a09-8645-1d3822cdc362')),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapec5f7cc6-4a, col_values=(('external_ids', {'iface-id': 'ec5f7cc6-4a67-45ee-8f8a-7637d6e74016', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:e2:11', 'vm-uuid': '785be94c-fda0-47b6-a345-39f3ba6043e2'}),), if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:14 user nova-compute[75258]: INFO os_vif [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=ec5f7cc6-4a67-45ee-8f8a-7637d6e74016,network=Network(575a863d-c2c1-48c4-a7eb-731e776c0881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5f7cc6-4a')
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No VIF found with MAC fa:16:3e:9f:e2:11, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.network.neutron [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated VIF entry in instance network info cache for port ec5f7cc6-4a67-45ee-8f8a-7637d6e74016. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG nova.network.neutron [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:52:14 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-4107d15a-e6f5-47d1-acf1-2ebb8e64974f req-4acfb6c8-6e6e-4eaf-8955-eaa617a481b6 service nova] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-b90c3d21-39cd-4050-811b-9b26a8b912dd req-5cc9f7cd-a0aa-4117-933b-9df6bb1aa0f5 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b90c3d21-39cd-4050-811b-9b26a8b912dd req-5cc9f7cd-a0aa-4117-933b-9df6bb1aa0f5 service nova] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b90c3d21-39cd-4050-811b-9b26a8b912dd req-5cc9f7cd-a0aa-4117-933b-9df6bb1aa0f5 service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-b90c3d21-39cd-4050-811b-9b26a8b912dd req-5cc9f7cd-a0aa-4117-933b-9df6bb1aa0f5 service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:15 user nova-compute[75258]: DEBUG nova.compute.manager [req-b90c3d21-39cd-4050-811b-9b26a8b912dd req-5cc9f7cd-a0aa-4117-933b-9df6bb1aa0f5 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] No waiting events found dispatching network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:52:15 user nova-compute[75258]: WARNING nova.compute.manager [req-b90c3d21-39cd-4050-811b-9b26a8b912dd req-5cc9f7cd-a0aa-4117-933b-9df6bb1aa0f5 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received unexpected event network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 for instance with vm_state building and task_state spawning.
Nov 14 13:52:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:16 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Instance event wait completed in 0 seconds for  {{(pid=75258) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Guest created on hypervisor {{(pid=75258) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4421}}
Nov 14 13:52:17 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Instance spawned successfully.
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:904}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Found default for hw_cdrom_bus of ide {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Found default for hw_disk_bus of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Found default for hw_input_bus of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Found default for hw_pointer_model of None {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Found default for hw_video_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Found default for hw_vif_model of virtio {{(pid=75258) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:933}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-830df73a-4e0a-4356-a4da-1ef74bbc6aba req-34c9231e-1c76-4a31-ac3a-b06bf597804f service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-830df73a-4e0a-4356-a4da-1ef74bbc6aba req-34c9231e-1c76-4a31-ac3a-b06bf597804f service nova] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-830df73a-4e0a-4356-a4da-1ef74bbc6aba req-34c9231e-1c76-4a31-ac3a-b06bf597804f service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-830df73a-4e0a-4356-a4da-1ef74bbc6aba req-34c9231e-1c76-4a31-ac3a-b06bf597804f service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:17 user nova-compute[75258]: DEBUG nova.compute.manager [req-830df73a-4e0a-4356-a4da-1ef74bbc6aba req-34c9231e-1c76-4a31-ac3a-b06bf597804f service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] No waiting events found dispatching network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:52:17 user nova-compute[75258]: WARNING nova.compute.manager [req-830df73a-4e0a-4356-a4da-1ef74bbc6aba req-34c9231e-1c76-4a31-ac3a-b06bf597804f service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received unexpected event network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 for instance with vm_state building and task_state spawning.
Nov 14 13:52:18 user nova-compute[75258]: INFO nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Took 6.10 seconds to spawn the instance on the hypervisor.
Nov 14 13:52:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Checking state {{(pid=75258) _get_power_state /opt/stack/nova/nova/compute/manager.py:1782}}
Nov 14 13:52:18 user nova-compute[75258]: INFO nova.compute.manager [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Took 6.69 seconds to build instance.
Nov 14 13:52:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-3081eab5-7997-44ba-9308-03a03f9d81ea tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.942s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.195s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:52:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:52:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8933MB free_disk=24.969905853271484GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 785be94c-fda0-47b6-a345-39f3ba6043e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:52:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.300s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:52:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:52:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:52:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:52:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:52:25 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:52:26 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:52:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:52:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:52:26 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:30 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_image_cache_manager_pass {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.register_storage_use.<locals>.do_register_storage_use" :: held 0.011s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "storage-registry-lock" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" acquired by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "storage-registry-lock" "released" by "nova.virt.storage_users.get_storage_users.<locals>.do_get_storage_users" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verify base images {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:314}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Image id b293cbf1-70d3-49f7-8a42-771d90e2ec06 yields fingerprint 5953b672b09d92bbfe59816f074eff61dfd18dae {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] image b293cbf1-70d3-49f7-8a42-771d90e2ec06 at (/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae): checking
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] image b293cbf1-70d3-49f7-8a42-771d90e2ec06 at (/opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae): image is in use {{(pid=75258) _mark_in_use /opt/stack/nova/nova/virt/libvirt/imagecache.py:279}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Image id  yields fingerprint da39a3ee5e6b4b0d3255bfef95601890afd80709 {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:319}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 785be94c-fda0-47b6-a345-39f3ba6043e2 is a valid instance name {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:126}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] 785be94c-fda0-47b6-a345-39f3ba6043e2 has a disk file {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:129}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 785be94c-fda0-47b6-a345-39f3ba6043e2 is backed by 5953b672b09d92bbfe59816f074eff61dfd18dae {{(pid=75258) _list_backing_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:141}}
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47
Nov 14 13:52:37 user nova-compute[75258]: WARNING nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Unknown base file: /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Active base files: /opt/stack/data/nova/instances/_base/5953b672b09d92bbfe59816f074eff61dfd18dae
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Removable base files: /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679 /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4 /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0 /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96 /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47 /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/b0c121b1a020bfb90985b15cb2b8d798f3482e6e
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/31097f6f7e78ecc9482835c0e8b002057cc9ceeb
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/2d3f3ef1e52b02caacabbfd367a80d51cfc19679
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/0ab3f23a7afa797f5aafba20b40f0d41d82204d4
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/65a3047828bca187056d8ac3a55d2e487b30c5a0
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/8cfce5d2125002f10be2aa30eb4a76bccdc8da96
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/1c9e890d089db7bda447341a45e98415b1709f2c
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/cc7215a757fb92605369d25de18577a96379fc47
Nov 14 13:52:37 user nova-compute[75258]: INFO nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Base, swap or ephemeral file too young to remove: /opt/stack/data/nova/instances/_base/9cecf8050bb7025d9a72b803f3d3fb2cfa792fb7
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verification complete {{(pid=75258) _age_and_verify_cached_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:350}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verify swap images {{(pid=75258) _age_and_verify_swap_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:299}}
Nov 14 13:52:37 user nova-compute[75258]: DEBUG nova.virt.libvirt.imagecache [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Verify ephemeral images {{(pid=75258) _age_and_verify_ephemeral_images /opt/stack/nova/nova/virt/libvirt/imagecache.py:284}}
Nov 14 13:52:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:40 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:45 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:50 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:52:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:53:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:53:22 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:53:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:53:23 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:53:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9027MB free_disk=24.93282699584961GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 785be94c-fda0-47b6-a345-39f3ba6043e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:53:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.271s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:53:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:53:25 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:53:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:53:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:53:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:39 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:39 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:53:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:53:49 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:53:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:53:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-changed-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG nova.compute.manager [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Refreshing instance network info cache due to event network-changed-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016. {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11117}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Refreshing network info cache for port ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2006}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated VIF entry in instance network info cache for port ec5f7cc6-4a67-45ee-8f8a-7637d6e74016. {{(pid=75258) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3481}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG nova.network.neutron [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:54:02 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-d7e02407-0b52-45c1-ab5e-6f3b8716a832 req-70e73ef8-56eb-493a-b5c7-756281213644 service nova] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:54:03 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_power_states {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:03 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Triggering sync for uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10332}}
Nov 14 13:54:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:54:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:54:03 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.024s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:54:04 user nova-compute[75258]: INFO nova.compute.manager [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attaching volume cd9ec466-7b43-4a2b-af6c-49efb793f5a2 to /dev/vdb
Nov 14 13:54:04 user nova-compute[75258]: DEBUG os_brick.utils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[160ce03e-fbf4-4759-82ae-a3c002a6d831]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bbe12b-1405-4409-8be5-118f9dcf63ee]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4146c40-ac33-4921-9f14-98b41d2f26bf]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3ac690e-3b4b-4d97-b052-754c71991a4b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:54:04 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:54:04 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[40678c4d-6d9b-44bb-a7ea-1f78a3d6ac57]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG os_brick.utils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:54:04 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating existing volume attachment record: 988be41d-141e-4991-a591-a0fdb37afa95 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:54:05 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKJCOSUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:54:09 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:54:09 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:54:09 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260" returned: 21 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcb38c3-afa1-482d-83a3-6720a2faf596]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:54:09 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd98977-7230-4f47-9026-79b1d5e04ed2]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2] added
Nov 14 13:54:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[078fb6b4-e548-455c-8add-b0455b79032b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3052676-e04f-4949-bb4f-752a0950aca4]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKJCOSUy {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rKJCOSUy" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[567913ab-754a-43cb-a3e6-2946d5a13af9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rKJCOSUy'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb566b0-b2e4-404f-8ed1-028f3e86ddf6]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b564cb9-b317-4a9c-8167-f5c0fa60b64d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:54:09 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:54:09 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:54:09 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:54:09 user nova-compute[75258]: 
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --login" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef19fddd-3efa-49ce-aa58-1a7066800088]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260]
Nov 14 13:54:09 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260] successful.
Nov 14 13:54:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[572ffe58-73a2-411e-9ff3-9ff125ef0f48]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[740c5e0f-dcda-42f2-971d-919bd1360472]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 (non-flash)
Nov 14 13:54:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 (non-flash)
Nov 14 13:54:09 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.252s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] HCTL ('33', '-', '-', 0) found on session 67 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2360c288-1aa5-4358-8b8c-18cccec44796]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:09 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching for a device in session 67 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKJCOSUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.285s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== connect_volume: return (1286ms) {'type': 'block', 'scsi_wwn': '23735373630623030', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23735373630623030', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG nova.objects.instance [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 13:54:10 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:54:10 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:54:10 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:54:10 user nova-compute[75258]:   <serial>cd9ec466-7b43-4a2b-af6c-49efb793f5a2</serial>
Nov 14 13:54:10 user nova-compute[75258]: </disk>
Nov 14 13:54:10 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No VIF found with MAC fa:16:3e:9f:e2:11, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:54:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-b85629a8-c288-4a65-8782-19a389def468 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.238s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:54:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:14 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:54:14 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:54:15 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:17 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:54:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:54:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:54:18 user nova-compute[75258]: INFO nova.compute.manager [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Detaching volume cd9ec466-7b43-4a2b-af6c-49efb793f5a2
Nov 14 13:54:18 user nova-compute[75258]: INFO nova.virt.block_device [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attempting to driver detach volume cd9ec466-7b43-4a2b-af6c-49efb793f5a2 from mountpoint /dev/vdb
Nov 14 13:54:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Attempting to detach device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 13:54:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:54:18 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:54:18 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:54:18 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:54:18 user nova-compute[75258]:   <serial>cd9ec466-7b43-4a2b-af6c-49efb793f5a2</serial>
Nov 14 13:54:18 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:54:18 user nova-compute[75258]: </disk>
Nov 14 13:54:18 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:54:18 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config.
Nov 14 13:54:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 13:54:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:54:18 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:54:18 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:54:18 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:54:18 user nova-compute[75258]:   <serial>cd9ec466-7b43-4a2b-af6c-49efb793f5a2</serial>
Nov 14 13:54:18 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:54:18 user nova-compute[75258]: </disk>
Nov 14 13:54:18 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:54:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 13:54:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:54:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:24 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:54:24 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9001MB free_disk=24.93163299560547GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 785be94c-fda0-47b6-a345-39f3ba6043e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:54:24 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:54:25 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:54:25 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:54:25 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:54:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:54:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.279s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:54:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:31 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:54:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:35 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:38 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 is timed out.
Nov 14 13:54:38 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config.
Nov 14 13:54:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rKJCOSUy', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:54:38 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9781aa2f-4bf4-44be-b085-2116a601ee1e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:54:38 user nova-compute[75258]: No targets found.
Nov 14 13:54:38 user nova-compute[75258]: iSNS:
Nov 14 13:54:38 user nova-compute[75258]: No targets found.
Nov 14 13:54:38 user nova-compute[75258]: STATIC:
Nov 14 13:54:38 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2
Nov 14 13:54:38 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:54:38 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:54:38 user nova-compute[75258]: FIRMWARE:
Nov 14 13:54:38 user nova-compute[75258]: No targets found.
Nov 14 13:54:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:54:38 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:54:38 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc20eebd-f1c6-43b5-921c-70be656fd5af]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac39da3-3c00-40fc-bcf5-50481c13de12]: (4, ('tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 (non-flash)
Nov 14 13:54:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [67] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 (non-flash)
Nov 14 13:54:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7aba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[3056f021-7ec0-4852-aa1f-56a7951b1e23]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe51a19-fd59-44c5-a285-5c3e00f88137]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.012s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[53dedc6b-89ad-4bf9-8543-644eab481d9e]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.040s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b9b0d5-4dc2-4431-8087-fcb85775cb0e]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e138f95-00a0-4a4e-97c7-9ce41781dca9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe12d3e3-d750-4612-8763-75f14c2c7b99]: (4, ('Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260]\nLogout of [sid: 67, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 67, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260]
Nov 14 13:54:38 user nova-compute[75258]: Logout of [sid: 67, target: iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2, portal: 172.16.0.220,3260] successful.
Nov 14 13:54:38 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cd9ec466-7b43-4a2b-af6c-49efb793f5a2 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4463658-94a7-4a6b-9796-39c42ec76f0b]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.278s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== disconnect_volume: return (279ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:54:38 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:54:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:39 user nova-compute[75258]: DEBUG nova.objects.instance [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:54:39 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-01c38800-c8f5-4e18-9116-ce74b330081f tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.564s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:54:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:54:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:54:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:54:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:54:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:54:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:54:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:54:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:54:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:04 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:55:10 user nova-compute[75258]: INFO nova.compute.manager [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attaching volume d0b1f146-035c-44aa-aab7-f9c935c107e9 to /dev/vdb
Nov 14 13:55:10 user nova-compute[75258]: DEBUG os_brick.utils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[69b2ebbc-974b-4150-81ed-8475d4564f0a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4b7040-29af-40b6-acf6-ad78ff239c37]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b5b8017-1474-4781-b8e4-aa8b2e22208a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a129bdbb-810d-48e0-bc9e-c15b34b9e9a0]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:55:10 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:55:10 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[def59f40-7818-4a33-9bed-36e50417dab4]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG os_brick.utils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating existing volume attachment record: 28553ab1-38f0-433f-9b52-8faa4a46576e {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:55:10 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgAwfEsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:55:15 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:55:15 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:55:15 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b91b05-67ce-4927-a27a-bef4395b77e6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:55:15 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[307da8cb-af57-48f2-a5a7-0bd151e7e7e0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9] added
Nov 14 13:55:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0627856a-bf33-449a-9623-77b644630358]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef12c6ba-f9a2-41d6-8642-bbb8a737d438]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgAwfEsJ {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HgAwfEsJ" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed15de95-7f79-4397-9ffc-aafe3b0f0579]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HgAwfEsJ'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8420d1ad-e8ea-46f3-93c9-0fd1e04f2ea9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b117a13-39e2-4f72-845c-e3ec53b1f11c]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:55:15 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:55:15 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:55:15 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:55:15 user nova-compute[75258]: 
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --login" returned: 0 in 0.043s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44e85e3-76af-4487-9846-58db21e67ef0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260]
Nov 14 13:55:15 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260] successful.
Nov 14 13:55:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[baee244a-6cea-480b-bd11-cec00b897de0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fadf181-f482-4f9e-8071-3f1fcf4148dd]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 (non-flash)
Nov 14 13:55:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 (non-flash)
Nov 14 13:55:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.238s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] HCTL ('33', '-', '-', 0) found on session 68 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f69bedd-3f83-43fe-8218-2f5ea8cf4848]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:15 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching for a device in session 68 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgAwfEsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.267s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== connect_volume: return (1269ms) {'type': 'block', 'scsi_wwn': '23934616236653638', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23934616236653638', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG nova.objects.instance [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 13:55:16 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:55:16 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:55:16 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:55:16 user nova-compute[75258]:   <serial>d0b1f146-035c-44aa-aab7-f9c935c107e9</serial>
Nov 14 13:55:16 user nova-compute[75258]: </disk>
Nov 14 13:55:16 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No VIF found with MAC fa:16:3e:9f:e2:11, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:55:16 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-f6dc1148-9cf7-4dec-810d-f81dab5fda6b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.717s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:55:17 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:55:19 user nova-compute[75258]: INFO nova.compute.manager [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Detaching volume d0b1f146-035c-44aa-aab7-f9c935c107e9
Nov 14 13:55:19 user nova-compute[75258]: INFO nova.virt.block_device [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attempting to driver detach volume d0b1f146-035c-44aa-aab7-f9c935c107e9 from mountpoint /dev/vdb
Nov 14 13:55:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Attempting to detach device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:55:19 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:55:19 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:55:19 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:55:19 user nova-compute[75258]:   <serial>d0b1f146-035c-44aa-aab7-f9c935c107e9</serial>
Nov 14 13:55:19 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:55:19 user nova-compute[75258]: </disk>
Nov 14 13:55:19 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:55:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config.
Nov 14 13:55:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 13:55:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:55:19 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:55:19 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:55:19 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:55:19 user nova-compute[75258]:   <serial>d0b1f146-035c-44aa-aab7-f9c935c107e9</serial>
Nov 14 13:55:19 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:55:19 user nova-compute[75258]: </disk>
Nov 14 13:55:19 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:55:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 13:55:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:55:24 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.192s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:25 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:55:25 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:55:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=24.930702209472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 785be94c-fda0-47b6-a345-39f3ba6043e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:55:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.189s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:55:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:40 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 is timed out.
Nov 14 13:55:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config.
Nov 14 13:55:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HgAwfEsJ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:55:40 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dcd68bb-ac5a-4f34-8926-edcb300b4a87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:55:40 user nova-compute[75258]: No targets found.
Nov 14 13:55:40 user nova-compute[75258]: iSNS:
Nov 14 13:55:40 user nova-compute[75258]: No targets found.
Nov 14 13:55:40 user nova-compute[75258]: STATIC:
Nov 14 13:55:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9
Nov 14 13:55:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:55:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:55:40 user nova-compute[75258]: FIRMWARE:
Nov 14 13:55:40 user nova-compute[75258]: No targets found.
Nov 14 13:55:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:55:40 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:55:40 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[eba831d3-f47d-4728-ba18-44dd7720a908]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[77c14350-6caf-4223-b8b3-f4ec18aeacb5]: (4, ('tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 (non-flash)
Nov 14 13:55:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [68] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 (non-flash)
Nov 14 13:55:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c799990>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[05c4db37-03cf-40fd-a73e-e5d8f867cafc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee856e1b-e2c3-4818-a81e-bbb788e65119]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[128066b3-17a8-46c1-b4c0-57588f6fe845]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.036s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[954c1e7c-f058-47a0-bbfa-4b77dd548dc7]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[da30f3a3-29fa-4c23-bdd9-b9a2bf0a22b9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa47c2d-8127-47a8-a643-3545c171dc04]: (4, ('Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260]\nLogout of [sid: 68, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 68, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260]
Nov 14 13:55:40 user nova-compute[75258]: Logout of [sid: 68, target: iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9, portal: 172.16.0.220,3260] successful.
Nov 14 13:55:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d0b1f146-035c-44aa-aab7-f9c935c107e9 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e3f0fb7-119e-4e04-98c6-3a1a079d63de]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== disconnect_volume: return (284ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:55:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:55:41 user nova-compute[75258]: DEBUG nova.objects.instance [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:55:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-61ff31f2-dcc7-4b37-ac6a-9fadc944ad23 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.592s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:55:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:55:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:53 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:55:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:55:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:55:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:55:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:55:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:56:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:56:11 user nova-compute[75258]: INFO nova.compute.manager [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attaching volume 290215d1-f009-4ea5-bbe7-ee23dd1f04bc to /dev/vdb
Nov 14 13:56:11 user nova-compute[75258]: DEBUG os_brick.utils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[15dfd2e9-88c2-4996-9b32-cc1d5a3e985c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[74aa2375-7743-439b-865e-6fa0692be5bf]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa885c6d-57ae-4aa8-bf0f-bb1f580f8a64]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[421ce8c7-8a77-4470-8649-1b937970d5a9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:56:11 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:56:11 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f71295-48d4-4eb9-8a74-45af27d0f62b]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG os_brick.utils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:56:11 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating existing volume attachment record: 02747b49-f380-4fa6-b01e-0b9e04a745b1 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:56:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:56:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:56:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:56:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:56:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVwrKmaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:56:15 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:56:15 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:56:15 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c11947-a981-4512-a5e4-b3409c885b6e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:56:15 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cef75a92-df21-4fca-9076-993ea20bc1d1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc] added
Nov 14 13:56:15 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d2e06fa-3750-4822-958d-7b1b344aff9c]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:15 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffde571a-2d8c-433c-8581-49d4dd46fe56]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVwrKmaW {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jVwrKmaW" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c34faadc-cdf5-434d-ac4b-44ce9aaf25d0]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jVwrKmaW'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec2ca72-083b-4531-af09-ded3febe6497]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[b085964b-c07c-460f-bfab-51f0b244c9eb]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:56:16 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:56:16 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:56:16 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:56:16 user nova-compute[75258]: 
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[872a66d0-a441-4334-b791-512b71a11532]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260]
Nov 14 13:56:16 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260] successful.
Nov 14 13:56:16 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdb93bf0-3f54-4525-babd-ddb298b253f2]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51844249-c794-488f-8e6a-2dd20aa27ecc]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc (non-flash)
Nov 14 13:56:16 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc (non-flash)
Nov 14 13:56:16 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.272s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] HCTL ('33', '-', '-', 0) found on session 69 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[14055090-7d8f-4d76-b9f8-4c6135fee4a8]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:16 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: None {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching for a device in session 69 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVwrKmaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.303s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26131663566303961', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26131663566303961', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG nova.objects.instance [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 13:56:17 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:56:17 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:56:17 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:56:17 user nova-compute[75258]:   <serial>290215d1-f009-4ea5-bbe7-ee23dd1f04bc</serial>
Nov 14 13:56:17 user nova-compute[75258]: </disk>
Nov 14 13:56:17 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No VIF found with MAC fa:16:3e:9f:e2:11, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:56:17 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-9cc0b97d-5182-4fb9-8a81-552d865442fd tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.057s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:56:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:56:19 user nova-compute[75258]: INFO nova.compute.manager [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Detaching volume 290215d1-f009-4ea5-bbe7-ee23dd1f04bc
Nov 14 13:56:19 user nova-compute[75258]: INFO nova.virt.block_device [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attempting to driver detach volume 290215d1-f009-4ea5-bbe7-ee23dd1f04bc from mountpoint /dev/vdb
Nov 14 13:56:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Attempting to detach device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:56:19 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:56:19 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:56:19 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:56:19 user nova-compute[75258]:   <serial>290215d1-f009-4ea5-bbe7-ee23dd1f04bc</serial>
Nov 14 13:56:19 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:56:19 user nova-compute[75258]: </disk>
Nov 14 13:56:19 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:56:19 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config.
Nov 14 13:56:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 13:56:19 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:56:19 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:56:19 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:56:19 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:56:19 user nova-compute[75258]:   <serial>290215d1-f009-4ea5-bbe7-ee23dd1f04bc</serial>
Nov 14 13:56:19 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:56:19 user nova-compute[75258]: </disk>
Nov 14 13:56:19 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:56:20 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 13:56:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:56:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:56:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9000MB free_disk=24.929676055908203GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 785be94c-fda0-47b6-a345-39f3ba6043e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:56:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.331s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:56:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:56:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5004 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:56:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:56:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:56:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:56:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:56:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:56:40 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 is timed out.
Nov 14 13:56:40 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config.
Nov 14 13:56:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jVwrKmaW', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:56:40 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[343ae2bd-3c17-4c19-81cd-12d6a11dc6da]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:56:40 user nova-compute[75258]: No targets found.
Nov 14 13:56:40 user nova-compute[75258]: iSNS:
Nov 14 13:56:40 user nova-compute[75258]: No targets found.
Nov 14 13:56:40 user nova-compute[75258]: STATIC:
Nov 14 13:56:40 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc
Nov 14 13:56:40 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:56:40 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:56:40 user nova-compute[75258]: FIRMWARE:
Nov 14 13:56:40 user nova-compute[75258]: No targets found.
Nov 14 13:56:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:56:40 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:56:40 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[51964830-6e45-49f6-9e00-7ae85c2fcbab]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f6ecde-7da8-49c4-bf7d-5d89bb70e458]: (4, ('tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc (non-flash)
Nov 14 13:56:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [69] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc (non-flash)
Nov 14 13:56:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7d53f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f54492a-87f8-4c92-90a3-c802dc278aa5]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ce098d-0235-40e7-9083-cda732acd3bc]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[de425efb-b93b-4698-8493-3cf00453d37a]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.041s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[95257ebf-053f-45f3-a9ab-18a8daf47579]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2a4124d-3d43-4ecd-beca-98c43c804b7d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8613db8-483f-4e64-a63a-a44988d23253]: (4, ('Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260]\nLogout of [sid: 69, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 69, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260]
Nov 14 13:56:40 user nova-compute[75258]: Logout of [sid: 69, target: iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc, portal: 172.16.0.220,3260] successful.
Nov 14 13:56:40 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:290215d1-f009-4ea5-bbe7-ee23dd1f04bc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f260099-d8b1-47fe-9092-bdf440672f23]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== disconnect_volume: return (312ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:56:40 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:56:41 user nova-compute[75258]: DEBUG nova.objects.instance [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:56:41 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-07442f6c-991a-4fc7-85a9-d77724abcc77 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.714s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:56:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:56:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:56:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:56:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:57:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:57:11 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:57:11 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:57:12 user nova-compute[75258]: INFO nova.compute.manager [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attaching volume c863892e-e6d4-4780-8ae2-ab5bab3e28b5 to /dev/vdb
Nov 14 13:57:12 user nova-compute[75258]: DEBUG os_brick.utils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[db610d08-dc1a-4b08-ae2f-fb78eea8b4d6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:f65ab6f8f3c8\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt -v / -n -o SOURCE {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt -v / -n -o SOURCE" returned: 0 in 0.015s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[08204e54-5d7c-4c59-863c-88eb3e2e3820]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e15bfa7-8dc0-4798-803b-c0aa705cb607]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[39971626-9ee7-4776-acea-aad433bbd4cf]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Running cmd (subprocess): nvme version {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] 'nvme version' failed. Not Retrying. {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:57:12 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] nvme not present on system {{(pid=75258) nvme_present /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/nvmeof.py:756}}
Nov 14 13:57:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:13 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:473}}
Nov 14 13:57:13 user nova-compute[75258]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Nov 14 13:57:13 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e71fc9-8725-440c-ad1f-00e0c0359033]: (4, '') {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:13 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=75258) find_dsc /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:98}}
Nov 14 13:57:13 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:76}}
Nov 14 13:57:13 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.lightos [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] LIGHTOS: no hostnqn found. {{(pid=75258) get_connector_properties /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/lightos.py:84}}
Nov 14 13:57:13 user nova-compute[75258]: DEBUG os_brick.utils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:f65ab6f8f3c8', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:57:13 user nova-compute[75258]: DEBUG nova.virt.block_device [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating existing volume attachment record: 7fa88151-7dcc-4625-9dd3-d052350fbe91 {{(pid=75258) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Nov 14 13:57:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:57:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:15 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Calling os-brick to attach iSCSI Volume {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPxWSbQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:57:17 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:57:17 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:57:17 user nova-compute[75258]: INFO os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[57f38d97-a5f3-4af0-956c-5d9e05d79f58]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Nov 14 13:57:17 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[40ec71bc-b27a-436a-a816-144ef5531d3e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5] added\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5] added
Nov 14 13:57:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[7aaf5b87-b9ec-443e-ab5c-18c99f4057e3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae8a90e1-b019-401f-b3f8-4795913bc583]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPxWSbQY {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v cPxWSbQY" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[072d3fa8-d204-4ca7-aa72-c152b9a9b9c5]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'cPxWSbQY'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee20956-f74f-4512-859a-a22954ab61f3]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b32bdc2-dfb1-4fa3-a526-66d3093f189d]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:57:17 user nova-compute[75258]:  {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Nov 14 13:57:17 user nova-compute[75258]:  {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:57:17 user nova-compute[75258]: WARNING os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Nov 14 13:57:17 user nova-compute[75258]: 
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --login {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[96560166-c199-4413-921c-c4047ed5438b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260]
Nov 14 13:57:17 user nova-compute[75258]: Login to [iface: default, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260] successful.
Nov 14 13:57:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[441ed7e5-bbe0-4f67-a212-208a2ecbadd9]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3fec8e-3f20-4b8a-8bef-2b4ca046326a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 (non-flash)
Nov 14 13:57:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 (non-flash)
Nov 14 13:57:17 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.270s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to 172.16.0.220:3260 {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:644}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] HCTL ('33', '-', '-', 0) found on session 70 with lun 0 {{(pid=75258) get_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:770}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=75258) scan_iscsi /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:795}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f3b3ad-a600-4e79-9bbc-4fe392960323]: (4, ('- - 0', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Searching for a device in session 70 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=75258) device_name_by_hctl /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:789}}
Nov 14 13:57:17 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPxWSbQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=75258) _connect_vol /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:672}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.302s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== connect_volume: return (1305ms) {'type': 'block', 'scsi_wwn': '26235383061363533', 'path': '/dev/sdb'} {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26235383061363533', 'path': '/dev/sdb'} {{(pid=75258) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG nova.objects.instance [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] attach device xml: <disk type="block" device="disk">
Nov 14 13:57:18 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:57:18 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:57:18 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:57:18 user nova-compute[75258]:   <serial>c863892e-e6d4-4780-8ae2-ab5bab3e28b5</serial>
Nov 14 13:57:18 user nova-compute[75258]: </disk>
Nov 14 13:57:18 user nova-compute[75258]:  {{(pid=75258) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vda, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No BDM found with device name vdb, not building metadata. {{(pid=75258) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] No VIF found with MAC fa:16:3e:9f:e2:11, not building metadata {{(pid=75258) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Nov 14 13:57:18 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-a3355562-6772-4bc9-bc6c-cb3eac306d9b tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 6.093s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:57:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:20 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:57:20 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:57:21 user nova-compute[75258]: INFO nova.compute.manager [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Detaching volume c863892e-e6d4-4780-8ae2-ab5bab3e28b5
Nov 14 13:57:21 user nova-compute[75258]: INFO nova.virt.block_device [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Attempting to driver detach volume c863892e-e6d4-4780-8ae2-ab5bab3e28b5 from mountpoint /dev/vdb
Nov 14 13:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Attempting to detach device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config. {{(pid=75258) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2487}}
Nov 14 13:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:57:21 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:57:21 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:57:21 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:57:21 user nova-compute[75258]:   <serial>c863892e-e6d4-4780-8ae2-ab5bab3e28b5</serial>
Nov 14 13:57:21 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:57:21 user nova-compute[75258]: </disk>
Nov 14 13:57:21 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:57:21 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the persistent domain config.
Nov 14 13:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config. {{(pid=75258) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2523}}
Nov 14 13:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.guest [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] detach device xml: <disk type="block" device="disk">
Nov 14 13:57:21 user nova-compute[75258]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Nov 14 13:57:21 user nova-compute[75258]:   <source dev="/dev/sdb"/>
Nov 14 13:57:21 user nova-compute[75258]:   <target dev="vdb" bus="virtio"/>
Nov 14 13:57:21 user nova-compute[75258]:   <serial>c863892e-e6d4-4780-8ae2-ab5bab3e28b5</serial>
Nov 14 13:57:21 user nova-compute[75258]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Nov 14 13:57:21 user nova-compute[75258]: </disk>
Nov 14 13:57:21 user nova-compute[75258]:  {{(pid=75258) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Nov 14 13:57:21 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:21 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:57:21 user nova-compute[75258]: DEBUG nova.virt.libvirt.driver [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2599}}
Nov 14 13:57:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:312}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquired lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:315}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Forcefully refreshing network info cache for instance {{(pid=75258) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2003}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lazy-loading 'info_cache' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG nova.network.neutron [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [{"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Releasing lock "refresh_cache-785be94c-fda0-47b6-a345-39f3ba6043e2" {{(pid=75258) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:333}}
Nov 14 13:57:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updated the network info_cache for instance {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9993}}
Nov 14 13:57:25 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:26 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=75258) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:57:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:57:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9003MB free_disk=24.928749084472656GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Instance 785be94c-fda0-47b6-a345-39f3ba6043e2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=75258) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:57:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:57:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:57:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:35 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:57:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:41 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Waiting for libvirt event about the detach of device vdb with device alias virtio-disk1 from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 is timed out.
Nov 14 13:57:41 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully detached device vdb from instance 785be94c-fda0-47b6-a345-39f3ba6043e2 from the live domain config.
Nov 14 13:57:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] calling os-brick to detach iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7fd4b456bdc0>, {'target_iqn': 'iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'cPxWSbQY', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:176}}
Nov 14 13:57:41 user nova-compute[75258]: WARNING os_brick.initiator.connectors.base [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:68}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:73}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbc4f38-88a8-4cd7-bec3-3596b4c8eca4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Nov 14 13:57:41 user nova-compute[75258]: No targets found.
Nov 14 13:57:41 user nova-compute[75258]: iSNS:
Nov 14 13:57:41 user nova-compute[75258]: No targets found.
Nov 14 13:57:41 user nova-compute[75258]: STATIC:
Nov 14 13:57:41 user nova-compute[75258]: Target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5
Nov 14 13:57:41 user nova-compute[75258]:         Portal: 172.16.0.220:3260,-1
Nov 14 13:57:41 user nova-compute[75258]:                 Iface Name: default
Nov 14 13:57:41 user nova-compute[75258]: FIRMWARE:
Nov 14 13:57:41 user nova-compute[75258]: No targets found.
Nov 14 13:57:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Nov 14 13:57:41 user nova-compute[75258]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Nov 14 13:57:41 user nova-compute[75258]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=75258) _get_discoverydb_portals /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:382}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5', 0)] {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:830}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4441c-3eec-4d7e-9b11-d4862ba8ecf1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e1da644-c529-4d97-9e14-0c3d3011b30a]: (4, ('tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 (non-flash)\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 (non-flash)
Nov 14 13:57:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1193}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsi session list stdout=tcp: [70] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 (non-flash)
Nov 14 13:57:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsi_session /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7fd49c7bd2d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5'): ({'sdb'}, set())}) {{(pid=75258) _get_connection_devices /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:863}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Removing single pathed devices sdb {{(pid=75258) remove_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:374}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c25e4b2f-5989-4dfb-8703-d88a76550550]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffedfbb-7639-4adc-851b-2507d10f82f5]: (4, ('ok\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Flushing IO for device /dev/sdb {{(pid=75258) flush_device_io /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:434}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.014s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[10cd6416-144f-42d1-af5d-4cc393e93f2d]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=75258) remove_scsi_device /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:148}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51d6246-92ba-4783-80f8-c9d8ca7eaad5]: (4, ('1', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:156}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.linuxscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] SCSI volumes sdb have been removed. {{(pid=75258) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/linuxscsi.py:166}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5')] {{(pid=75258) _disconnect_connection /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a4717d-e4d4-4388-b5d1-b855443ac2db]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --logout {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.049s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b362093-31da-4cff-b8cf-7eeb7a1776ae]: (4, ('Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260]\nLogout of [sid: 70, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 70, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260]
Nov 14 13:57:41 user nova-compute[75258]: Logout of [sid: 70, target: iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5, portal: 172.16.0.220,3260] successful.
Nov 14 13:57:41 user nova-compute[75258]:  stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op delete {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:384}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c863892e-e6d4-4780-8ae2-ab5bab3e28b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=86014) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:422}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG oslo.privsep.daemon [-] privsep: reply[941cebb2-f1b9-4ec8-9d82-cc7478fd056f]: (4, ('', '')) {{(pid=86014) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:499}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=75258) _run_iscsiadm /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/iscsi.py:1037}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.base [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/initiator/connectors/base.py:87}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG os_brick.initiator.connectors.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] <== disconnect_volume: return (320ms) None {{(pid=75258) trace_logging_wrapper /opt/stack/data/venv/lib/python3.10/site-packages/os_brick/utils.py:203}}
Nov 14 13:57:41 user nova-compute[75258]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Disconnected iSCSI Volume {{(pid=75258) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Nov 14 13:57:42 user nova-compute[75258]: DEBUG nova.objects.instance [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'flavor' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:57:42 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-ee897681-77e8-4416-8f3b-764dffbdc665 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 21.750s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:57:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:57:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:57:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:57:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:57:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:57:55 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:57:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:58:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:05 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:58:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4997-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:58:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:58:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:19 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:23 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:58:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:58:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:58:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:58:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:58:23 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:58:23 user nova-compute[75258]: INFO nova.compute.manager [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Terminating instance
Nov 14 13:58:23 user nova-compute[75258]: DEBUG nova.compute.manager [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Start destroying the instance on the hypervisor. {{(pid=75258) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3140}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-26d04251-3991-4a67-b0b3-0289b1714b2a req-e0f5717d-4bff-4bf3-adb3-957787fabb53 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-vif-unplugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-26d04251-3991-4a67-b0b3-0289b1714b2a req-e0f5717d-4bff-4bf3-adb3-957787fabb53 service nova] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-26d04251-3991-4a67-b0b3-0289b1714b2a req-e0f5717d-4bff-4bf3-adb3-957787fabb53 service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-26d04251-3991-4a67-b0b3-0289b1714b2a req-e0f5717d-4bff-4bf3-adb3-957787fabb53 service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-26d04251-3991-4a67-b0b3-0289b1714b2a req-e0f5717d-4bff-4bf3-adb3-957787fabb53 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] No waiting events found dispatching network-vif-unplugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.compute.manager [req-26d04251-3991-4a67-b0b3-0289b1714b2a req-e0f5717d-4bff-4bf3-adb3-957787fabb53 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-vif-unplugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 for instance with task_state deleting. {{(pid=75258) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10890}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [-] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Instance destroyed successfully.
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.objects.instance [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lazy-loading 'resources' on Instance uuid 785be94c-fda0-47b6-a345-39f3ba6043e2 {{(pid=75258) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1141}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.virt.libvirt.vif [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-11-14T13:52:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-327591221',display_name='tempest-SnapshotDataIntegrityTests-server-327591221',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-327591221',id=53,image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAVTFxLT7SWXbLAsEeNNALOAjjb2sMjm65tfZqUImxh9zeHYp4EaWbPXBXObykZSc3g/BSKcPjVvEegngCgPvxoLuuVYwh5CmSVp6esANdUlzlZLHsUAIDUCHa2pHZTydg==',key_name='tempest-keypair-1488094953',keypairs=<?>,launch_index=0,launched_at=2023-11-14T13:52:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4ec754f200c54f5db97d0706ca7d9c12',ramdisk_id='',reservation_id='r-v3r0o9l6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='b293cbf1-70d3-49f7-8a42-771d90e2ec06',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-1169061154',owner_user_name='tempest-SnapshotDataIntegrityTests-1169061154-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-11-14T13:52:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8d0a9b3b072440c48b6be1ba64056b64',uuid=785be94c-fda0-47b6-a345-39f3ba6043e2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Converting VIF {"id": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "address": "fa:16:3e:9f:e2:11", "network": {"id": "575a863d-c2c1-48c4-a7eb-731e776c0881", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-393671231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4ec754f200c54f5db97d0706ca7d9c12", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapec5f7cc6-4a", "ovs_interfaceid": "ec5f7cc6-4a67-45ee-8f8a-7637d6e74016", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.network.os_vif_util [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=ec5f7cc6-4a67-45ee-8f8a-7637d6e74016,network=Network(575a863d-c2c1-48c4-a7eb-731e776c0881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5f7cc6-4a') {{(pid=75258) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG os_vif [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=ec5f7cc6-4a67-45ee-8f8a-7637d6e74016,network=Network(575a863d-c2c1-48c4-a7eb-731e776c0881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5f7cc6-4a') {{(pid=75258) unplug /opt/stack/data/venv/lib/python3.10/site-packages/os_vif/__init__.py:109}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapec5f7cc6-4a, bridge=br-int, if_exists=True) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 20 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=95a54cb8-e855-4a09-8645-1d3822cdc362) {{(pid=75258) do_commit /opt/stack/data/venv/lib/python3.10/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:24 user nova-compute[75258]: INFO os_vif [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9f:e2:11,bridge_name='br-int',has_traffic_filtering=True,id=ec5f7cc6-4a67-45ee-8f8a-7637d6e74016,network=Network(575a863d-c2c1-48c4-a7eb-731e776c0881),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapec5f7cc6-4a')
Nov 14 13:58:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Deleting instance files /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2_del
Nov 14 13:58:24 user nova-compute[75258]: INFO nova.virt.libvirt.driver [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Deletion of /opt/stack/data/nova/instances/785be94c-fda0-47b6-a345-39f3ba6043e2_del complete
Nov 14 13:58:24 user nova-compute[75258]: INFO nova.compute.manager [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Took 0.95 seconds to destroy the instance on the hypervisor.
Nov 14 13:58:24 user nova-compute[75258]: DEBUG oslo.service.loopingcall [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=75258) func /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/loopingcall.py:435}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.compute.manager [-] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Deallocating network for instance {{(pid=75258) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2279}}
Nov 14 13:58:24 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] deallocate_for_instance() {{(pid=75258) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1802}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Skipping network cache update for instance because it is being deleted. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9939}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.network.neutron [-] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Updating instance_info_cache with network_info: [] {{(pid=75258) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Nov 14 13:58:25 user nova-compute[75258]: INFO nova.compute.manager [-] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Took 0.86 seconds to deallocate network for instance.
Nov 14 13:58:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.compute.manager [req-e37e21e6-29ac-4f99-bcfd-6cc9a93c48bd req-80a05ec2-653b-4aa9-8ad2-fed8ea56e47e service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-vif-deleted-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:58:25 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.147s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:58:26 user nova-compute[75258]: INFO nova.scheduler.client.report [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Deleted allocations for instance 785be94c-fda0-47b6-a345-39f3ba6043e2
Nov 14 13:58:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-77c86c29-d66e-45fd-89ba-9239baf84310 tempest-SnapshotDataIntegrityTests-1169061154 tempest-SnapshotDataIntegrityTests-1169061154-project-member] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.162s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:58:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa7cb80d-1404-4e26-b4d3-1bbec3ae0171 req-f32839b8-8ec8-41a6-b60b-f0a0a9701121 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received event network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) external_instance_event /opt/stack/nova/nova/compute/manager.py:11112}}
Nov 14 13:58:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa7cb80d-1404-4e26-b4d3-1bbec3ae0171 req-f32839b8-8ec8-41a6-b60b-f0a0a9701121 service nova] Acquiring lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:58:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa7cb80d-1404-4e26-b4d3-1bbec3ae0171 req-f32839b8-8ec8-41a6-b60b-f0a0a9701121 service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:58:26 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [req-aa7cb80d-1404-4e26-b4d3-1bbec3ae0171 req-f32839b8-8ec8-41a6-b60b-f0a0a9701121 service nova] Lock "785be94c-fda0-47b6-a345-39f3ba6043e2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:58:26 user nova-compute[75258]: DEBUG nova.compute.manager [req-aa7cb80d-1404-4e26-b4d3-1bbec3ae0171 req-f32839b8-8ec8-41a6-b60b-f0a0a9701121 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] No waiting events found dispatching network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 {{(pid=75258) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Nov 14 13:58:26 user nova-compute[75258]: WARNING nova.compute.manager [req-aa7cb80d-1404-4e26-b4d3-1bbec3ae0171 req-f32839b8-8ec8-41a6-b60b-f0a0a9701121 service nova] [instance: 785be94c-fda0-47b6-a345-39f3ba6043e2] Received unexpected event network-vif-plugged-ec5f7cc6-4a67-45ee-8f8a-7637d6e74016 for instance with vm_state deleted and task_state None.
Nov 14 13:58:27 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:58:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:58:27 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:58:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9166MB free_disk=24.95584487915039GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:58:27 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:58:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:30 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=75258) run /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:117}}
Nov 14 13:58:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=75258) _transition /opt/stack/data/venv/lib/python3.10/site-packages/ovs/reconnect.py:519}}
Nov 14 13:58:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:44 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:46 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:58:46 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances with incomplete migration  {{(pid=75258) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11247}}
Nov 14 13:58:49 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:58:54 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:58:59 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:04 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:06 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:09 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:59:14 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:248}}
Nov 14 13:59:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:18 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Cleaning up deleted instances {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11209}}
Nov 14 13:59:18 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] There are 0 instances to clean {{(pid=75258) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11218}}
Nov 14 13:59:18 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:19 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:20 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:21 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:24 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:24 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=75258) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10541}}
Nov 14 13:59:24 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:26 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Starting heal instance info cache {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9922}}
Nov 14 13:59:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Rebuilding the list of instances to heal {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9926}}
Nov 14 13:59:26 user nova-compute[75258]: DEBUG nova.compute.manager [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Didn't find any instances for network info cache update. {{(pid=75258) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:10008}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager.update_available_resource {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Auditing locally available compute resources for user (node: user) {{(pid=75258) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Nov 14 13:59:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:59:29 user nova-compute[75258]: WARNING nova.virt.libvirt.driver [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Hypervisor/Node resource view: name=user free_ram=9289MB free_disk=24.954757690429688GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=75258) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:404}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:409}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=75258) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing inventories for resource provider 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating ProviderTree inventory for provider 57b222fc-6379-46c4-a979-ca3142626f72 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Updating inventory in ProviderTree for provider 57b222fc-6379-46c4-a979-ca3142626f72 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing aggregate associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, aggregates: None {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Nov 14 13:59:29 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Refreshing trait associations for resource provider 57b222fc-6379-46c4-a979-ca3142626f72, traits: HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_AUTO,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_RESCUE_BFV,COMPUTE_VOLUME_EXTEND,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,HW_CPU_X86_SSSE3,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_IMAGE_TYPE_ARI,HW_CPU_X86_SSE41,HW_CPU_X86_SSE,COMPUTE_DEVICE_TAGGING,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_TRUSTED_CERTS,HW_CPU_X86_MMX,COMPUTE_IMAGE_TYPE_RAW,HW_CPU_X86_SSE2,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_STORAGE_BUS_FDC,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_NODE,COMPUTE_STORAGE_BUS_USB,COMPUTE_STORAGE_BUS_SATA,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_STORAGE_BUS_VIRTIO,COMPUTE_ACCELERATORS,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_IMAGE_TYPE_QCOW2 {{(pid=75258) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Nov 14 13:59:30 user nova-compute[75258]: DEBUG nova.compute.provider_tree [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed in ProviderTree for provider: 57b222fc-6379-46c4-a979-ca3142626f72 {{(pid=75258) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Nov 14 13:59:30 user nova-compute[75258]: DEBUG nova.scheduler.client.report [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Inventory has not changed for provider 57b222fc-6379-46c4-a979-ca3142626f72 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=75258) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Nov 14 13:59:30 user nova-compute[75258]: DEBUG nova.compute.resource_tracker [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Compute_service record updated for user:user {{(pid=75258) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Nov 14 13:59:30 user nova-compute[75258]: DEBUG oslo_concurrency.lockutils [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.232s {{(pid=75258) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:423}}
Nov 14 13:59:33 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:34 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}
Nov 14 13:59:36 user nova-compute[75258]: DEBUG oslo_service.periodic_task [None req-4a9ab743-209c-45aa-ba09-f7a08eeaa354 None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=75258) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Nov 14 13:59:39 user nova-compute[75258]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=75258) __log_wakeup /opt/stack/data/venv/lib/python3.10/site-packages/ovs/poller.py:263}}